Gossamer Forum
Home : Products : Gossamer Links : Development, Plugins and Globals :

Spider Plugin - Import only

Quote Reply
Spider Plugin - Import only
Spider Plugin,

Ive looked on both the gossamer spider and Andy's plugin spider. But I can really confirm if it can do what I need it for.

Im wondering if any of the two or any other plugin can do the following.

Spider, index and add links to the database.. by Admin / Myself giving the spider a URL, for example http://dir.yahoo.com/...d_Internet/Contests/ which contains the links im interested in. The spider visit the URL and pull all the URL from that page, go to those pages (no further) and pull their titles, description etc and add them into my database for me to validate them and also select a category for them.

What Im trying to do is to simply be able to add links with their description from other sites to my own database. Much like google or yahoo does..

The existing spiders does not seem to able to do this, am I wrong? It seems as a fairly simple thing to do but there isnt any automatic way to do it, the closest thing I can see is a DMOZ import, but im not willing to download a 2gig file to my server etc..
Subject Author Views Date
Thread Spider Plugin - Import only demon 3131 May 13, 2004, 3:56 AM
Thread Re: [demon] Spider Plugin - Import only
Andy 3040 May 13, 2004, 6:40 AM
Post Re: [Andy] Spider Plugin - Import only
demon 3030 May 13, 2004, 3:47 PM
Thread Re: [Andy] Spider Plugin - Import only
webslicer 3034 May 13, 2004, 4:17 PM
Post Re: [webslicer] Spider Plugin - Import only
Andy 3015 May 14, 2004, 12:11 AM