Hi Kilroy,
1. You can use the spider's filters to spider only the tlds. However, it's not just a keyword based filter and you'll have to write some perl code. The api for the spider's filters can be found here: http://www.gossamer-threads.com/perl/plugins/help.cgi?do=help&topic=Spider/rules_screen.html
2. By default, if the plugin is installed, the site is searched first than if there are no results, it will search the spider database. You can set it up to search the spider database ONLY or always include the results from the spider database.
Hope this helps,
Aki
1. You can use the spider's filters to spider only the tlds. However, it's not just a keyword based filter and you'll have to write some perl code. The api for the spider's filters can be found here: http://www.gossamer-threads.com/perl/plugins/help.cgi?do=help&topic=Spider/rules_screen.html
2. By default, if the plugin is installed, the site is searched first than if there are no results, it will search the spider database. You can set it up to search the spider database ONLY or always include the results from the spider database.
Hope this helps,
Aki