Gossamer Forum
Home : Gossamer Threads Inc. : Custom Modification Jobs :

wanted now: spider/bot to automate update process

Quote Reply
wanted now: spider/bot to automate update process
I run links sql v2.0 with a database of some 30,000 links.

The directory is young and while direct submissions are rising, I'm still have to go out to other directories and use their listings to add to my directory.

That has to be done manually and takes a lot of time that would be better used elsewhere.

I absolutely need to automate this process and there has to be a way to do it!

what i need is a spider or bot or something that will go to a site url extract new links, then go to the new links for additional info(ie description) and put that information in my database for later editing.

Ideally the spider/bot needs to be time sensitive.... ie extra links from a certain date

and i could use it yesterday.

any questions?... just email sauron@telus.net or hit me up on ica 848616

Last edited by:

jonathonarcher: Sep 9, 2002, 4:04 PM
Subject Author Views Date
Thread wanted now: spider/bot to automate update process archer 2727 Sep 9, 2002, 4:01 PM
Thread Re: [jonathonarcher] wanted now: spider/bot to automate update process
Paul 2646 Sep 9, 2002, 4:42 PM
Post Re: [Paul] wanted now: spider/bot to automate update process
archer 2656 Sep 9, 2002, 4:48 PM