Alex, i would like to be able to do some searching in a database you have spidered to see how results come back. I want to get an idea what would happened if after spidering all the links in my directory i did a 1 word search. How are the sides ranked in search (keyword density?) these sort of things....
http://www.ASciFi.com/ - The Science Fiction Portal
http://www.ASciFi.com/ - The Science Fiction Portal