Gossamer Forum
Quote Reply
Re: Spider 2.0 In reply to
I'm having some similar issues.

I had to start the spider as "root" (I think because my userID did not have access to the database the spider was trying to run as). Because it was "root", perhaps there was no way for the program to cause it to stop, although the password should allow the program to stop from the inside.

The spider did not shutdown from the admin panel, or if it did, the delay was so long, it was not possible to determine that it really did. There should be some extra status message "shutting down...." or "restarting...." if the command was accepted, and child processes were waiting to die off.

I never got two spiders, but I did have a problem starting the spider. I tried it both with and without "&", and depending on how I was running it, it worked both ways, (or not both ways, depending on how you were looking at it).

added 0
new_hosts 4
queued 5216
rejected 0
total_Hosts 1
total_Queue 100
total_Rejected 4
total_links 0

I would like a better explanation of what each of those parameters is, and what is going on with the insertions to the database.

I actually got more spidering activity with this version, than with previous ones. There are still some issues, most of which are probably related to not really knowing how to use/run the spider properly (as intended), before trying to make it do other stuff :)

PUGDOGŪ Enterprises, Inc.
FAQ:http://LinkSQL.com/FAQ
Forum:http://LinkSQL.com/forum
Subject Author Views Date
Thread Spider 2.0 Alex 6144 Jun 14, 2001, 6:25 PM
Thread Re: Spider 2.0
Kjetil 5966 Jun 18, 2001, 1:12 AM
Post Re: Spider 2.0
pugdog 5911 Jun 19, 2001, 8:42 AM
Thread Re: Spider 2.0
wilhelm 5882 Jun 19, 2001, 4:06 PM
Thread Re: Spider 2.0
pugdog 5908 Jun 19, 2001, 7:25 PM
Post Re: Spider 2.0
wilhelm 5854 Jun 20, 2001, 8:50 AM
Thread Re: Spider 2.0
kitsune 5845 Jun 20, 2001, 4:11 PM
Post Re: Spider 2.0
wilhelm 5771 Jun 25, 2001, 3:46 PM
Thread Re: Spider 2.0
Kjetil 5857 Jun 20, 2001, 8:58 AM
Post Re: Spider 2.0
kitsune 5839 Jun 20, 2001, 4:12 PM