Home : Gossamer Threads Inc. : Custom Modification Jobs :

Gossamer Threads Inc.: Custom Modification Jobs: wanted now: spider/bot to automate update process: Edit Log

Here is the list of edits for this post
wanted now: spider/bot to automate update process
I run links sql v2.0 with a database of some 30,000 links.

The directory is young and while direct submissions are rising, I'm still have to go out to other directories and use their listings to add to my directory.

That has to be done manually and takes a lot of time that would be better used elsewhere.

I absolutely need to automate this process and there has to be a way to do it!

what i need is a spider or bot or something that will go to a site url extract new links, then go to the new links for additional info(ie description) and put that information in my database for later editing.

Ideally the spider/bot needs to be time sensitive.... ie extra links from a certain date

and i could use it yesterday.

any questions?... just email sauron@telus.net or hit me up on ica 848616

Last edited by:

jonathonarcher: Sep 9, 2002, 4:04 PM

Edit Log: