Hey,
At some point i had a piece of softwarefrom sumbody in here i think that would spider search engines. you just gave it a search term, and it would run the search on AV, Yahoo, exite, and some brazilian engine.
anybody know what it was called?
Thanks!

------------------
Ted Wilcox
http://www.cyber-find.com

no, it didnt spider at run time. it was a program that you run locally to build an index, and it could automatically submit them into links.

There was a script called altavista.cgi, which spidered Altavista search engine. But I do not think there was a Meta Search script discussed in either of the LINKS forums. You might want to try searching the CGI/PERL Forum.

Regards,

------------------
Eliot Lee
Founder and Editor
Anthro TECH, L.L.C
http://www.anthrotech.com/
info@anthrotech.com
==========================
Coconino Community College
http://www.coco.cc.az.us/
Web Technology
Coordinator
elee@coco.cc.az.us

There is a script called geturl.cgi, which is discussed over in the LINKS MODIFICATION Forum. Look in the wow Thread.

Regards,

------------------
Eliot Lee
Founder and Editor
Anthro TECH, L.L.C
http://www.anthrotech.com/
info@anthrotech.com
==========================
Coconino Community College
http://www.coco.cc.az.us/
Web Technology
Coordinator
elee@coco.cc.az.us

Thanks, that looks pretty cool, and ill see if i cant get a copy of that spider. Thats still not what i was looking for, though. does anybody know what im talking about?
Any help would be greatly appreciated.

------------------
Ted Wilcox
http://www.cyber-find.com

mathboy,

I just spend a quick five minutes searching the forums and came up with some Threads that discuss Spider Pro and Indexed Search. May be these are the Threads you are looking for:

http://www.gossamer-threads.com/scripts/forum/resources/Forum11/HTML/000829.html
http://www.gossamer-threads.com/scripts/forum/resources/Forum11/HTML/000839.html
http://www.gossamer-threads.com/scripts/forum/resources/Forum3/HTML/000426.html




Regards,

------------------
Eliot Lee
Founder and Editor
Anthro TECH, L.L.C
http://www.anthrotech.com/
info@anthrotech.com
==========================
Coconino Community College
http://www.coco.cc.az.us/
Web Technology
Coordinator
elee@coco.cc.az.us

Do you mean a Search engine spider that searches for terms, like Chatalogica Meta Crawler, that searches like Lycos, Altavista, blah blah and brings back the results? If so its at so http://www.chatologica.com/ and see if thats what you want.

Maybe I'm not being clear, or nobody remembers, but there was a program that would run on your local win9x desktop, and you would give it a search term. it would then do a meta search on AV, Yahoo, Excite, and some brazilian engine, and display all the results in that local software windows. it could then submit them to your links DB with one click. it was a very good way to add good sites to your DB. can anybody help? thanks!

------------------
Ted Wilcox
http://www.cyber-find.com

Yes there is a very nice program around called url spider pro - it spiders and will then convert to a links datbase format.

Simon

Actually - Im interested in aspider that will spider a whole category from Yahoo - anyone heard of one?