Gossamer Forum
Quote Reply
Spider 2.1 -rules
I have been playing around with the spider 2.1 for some time now. The installation worked fine, the status works, I can stop an pause the spider from web. Which is all fine, BUT:

The reason why I bought the spider was the promise that you can use spider rules to get only the specific pages that YOU want in your database.

I can not get this to work. I made a rule to get only the pages with a very rare word in the data. I knew that this word was only on two or three of the pages on my site. The I spidererd my site. - the rule didn't work at all, all pages on my site came up for validation!

So please... what are we doing wrong? Can anyone give some instructions on how to use the spider rules?

Subject Author Views Date
Thread Spider 2.1 -rules Kjetil 3768 Jul 23, 2001, 3:36 PM
Thread Re: Spider 2.1 -rules
pugdog 3651 Jul 24, 2001, 11:40 AM
Thread Re: Spider 2.1 -rules
Kjetil 3603 Jul 26, 2001, 11:41 AM
Thread Re: Spider 2.1 -rules
pugdog 3615 Jul 26, 2001, 11:42 AM
Thread Re: Spider 2.1 -rules
HEMEN 3528 Jul 30, 2001, 2:39 PM
Post Re: Spider 2.1 -rules
HEMEN 3487 Aug 1, 2001, 12:14 AM