Gossamer Forum
Quote Reply
Free Spider Script
Hello everyone,

Does anyone know of a free CGI/Perl spider script? I'm not talking about one that was created as a plugin for Links SQL, but but as a script to spider meta tags and submit the information to a search engine? I've searched through multiple CGI resource directory only to find dead links or scripts written in PHP (which is a backup). I want a simple script that will grab the Meta Tag information (and whatever else spiders grab) from a URL that I enter so I can modify it for my needs. Being a Christian search engine, we have no money to spend on plugins, so we try to create whatever features we want/need. Thanks for your time!

Daniel

Christian Search Network - http://www.csnhome.com
Quote Reply
Re: [OneDanShow] Free Spider Script In reply to
http://www.iuni.com/software


http://www.iuni.com/...tware/web/index.html
Links Plugins
Quote Reply
Re: [Ian] Free Spider Script In reply to
Ian;

Quote:
Does anyone know of a free CGI/Perl spider script

He said free...LOL

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] Free Spider Script In reply to
LOL - I looked at the links myself and thought exactly the same thing!

honest mistake of course... Wink

r
Quote Reply
Re: [ryel01] Free Spider Script In reply to
Wink


http://www.iuni.com/...tware/web/index.html
Links Plugins