Hello everyone,

Does anyone know of a free CGI/Perl spider script? I'm not talking about one that was created as a plugin for Links SQL, but but as a script to spider meta tags and submit the information to a search engine? I've searched through multiple CGI resource directory only to find dead links or scripts written in PHP (which is a backup). I want a simple script that will grab the Meta Tag information (and whatever else spiders grab) from a URL that I enter so I can modify it for my needs. Being a Christian search engine, we have no money to spend on plugins, so we try to create whatever features we want/need. Thanks for your time!

Daniel

Christian Search Network - http://www.csnhome.com