Gossamer Forum
Quote Reply
spider plugin request
This is a development request for a plugin for the latest version of Links SQL

I would like a user friendly, robust, version of Gossamer's spider. They are currently working on a new version but it doesn't sound like it is going to be ready soon.

I need a spider that I can point to a particular website/directory and which then:

a) download their latest submissions within a time frame i set.
(including site name, description, url, and if available email address)

b) go into my current database, visit the urls it contains and if possible add email addresses to the relevant database url.

c) anything else the current spider does

This is a serious request and rather more urgent than not.