Gossamer Forum
Quote Reply
Spider configuration
I am looking at the configuration page on the links spider help page. It describes spider_out, skip_validation, etc. I think these options are great, the only problem is that I can't figure out where I am supposed to go to change these options. Could someone please point me in the right direction?

On a related note, what are the default settings for the spider? I guess if I could find the config I could figure that out on my own, hehe

Also, is it possible to spider "only" the keywords, content, etc. of the selected websites, and not spider the links?

Thx


Rob Bartlett
AAA Internet Publishing, Inc.
http://www.AAAInternet.com
Quote Reply
Re: Spider configuration In reply to
Hi,

You can find the config at Plugins->Plugin Manager, and then click on Edit besides the Spider plugin.

Yes, this would be possible using Rules. Set a rule that matches everything and tell it to only index, not spider.

Cheers,

Alex

--
Gossamer Threads Inc.
Quote Reply
Re: Spider configuration In reply to
Ok, thx, I think I might need a little more direction though. I assume the "best" way to do this would be:

Last Modified
Less Than or Equal To
Tomorrow's Date (what format do I need to use?)
Force Indexing
Parameter (do I need to set this?)
Code (do I need to set this?)

If I use the above logic, will the pages "only" be indexed, not spidered, or will I have to change something?

Thx



Rob Bartlett
AAA Internet Publishing, Inc.
http://www.AAAInternet.com
Quote Reply
Re: Spider configuration In reply to
Nevermind, I found an easier way to do it. I am going to force indexing for all sites that do not have the word "xircumflixen" in their title. ;)

Thx



Rob Bartlett
AAA Internet Publishing, Inc.
http://www.AAAInternet.com