Gossamer Forum
Home : Products : Gossamer Links : Version 1.x :

automatic spidering for links?

Quote Reply
automatic spidering for links?
Anyone know if it's possible to automate the process of surfing the web for links to then manually add to your LinksSQL?

Example--you have a site on fly fishing and want to create the world's biggest fly fishing web-index of sites. Unfortunately you don't have time or the inclination to surf the Web, finding sites and then adding them one-by-one.

Any thoughts or am I daydreaming of a perfect world?
Quote Reply
Re: automatic spidering for links? In reply to
We are working on just that, a targeted spider. It's about three weeks away from completetion (we've been sidetracked with another project).

Basically you can seed it with some initial links, and define a set of rules for what is a link you want to follow, then let it go search the web.

We'll post more details as they become available.

Cheers,

Alex
Quote Reply
Re: automatic spidering for links? In reply to
How is this going? I am looking forward to using this.
Quote Reply
Re: [AtoZ] automatic spidering for links? In reply to
Hi Alex !

Any news on this new feature ?

Thanks,

Rob.
Quote Reply
Re: [netcomve] automatic spidering for links? In reply to
Hi,

See: http://www.gossamer-threads.com/scripts/plugins/spider/

Cheers,

Alex
--
Gossamer Threads Inc.
Quote Reply
Re: [netcomve] automatic spidering for links? In reply to
Note the Spider is for version 2 Wink

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package (plugins total "value" $3,325 & rising, for just $350)| GLinks ULTRA Package PRO (plugins total "value" $5,625 & rising, for just $500)
Support Forum | Links SQL Plugins | DMOZ Dumps | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Compare our different Plugin packages *new* Free CSS Templates