Gossamer Forum
Home : Products : Links 2.0 : Customization :

a metacrawler?

Quote Reply
a metacrawler?
I'm new to links, so maybe this has already been addressed but I don't see any info on it.

I need to know of any kind of mod or script that will allow me to type a list of URL's and then the script will extract meta descriptions & keywords etc. and plug them into the add.cgi form so they can be validated.

Any help would be great!

Thanks,
SaintSilver
Quote Reply
Re: a metacrawler? In reply to
It has....There a few Threads in this Forum that discuss spidering web sites out in the Net and then adding them into a temporary file that could be validated and added into the links.db file.

Look for a Thread entitled wow. Also there is a commerical product called Spider Pro that works in conjunction with LINKS. Look for Threads entitled something like Spider, Spider Pro, etc.

Hope this helps.

Regards,

------------------
Eliot Lee
Founder and Editor
Anthro TECH, L.L.C
http://www.anthrotech.com/
info@anthrotech.com
==========================
Coconino Community College
http://www.coco.cc.az.us/
Web Technology
Coordinator
elee@coco.cc.az.us

[This message has been edited by Eliot (edited October 06, 1999).]
Quote Reply
Re: a metacrawler? In reply to
Thanks for the input. However, I can't find a thread called wow. Also, Spider Pro is only for Windows. I'm developing on a Mac, and serving on UNIX. Is there any other ideas. I saw some mention of some freeware/shareware scripts that might work but they had no names and no information on where to find them.

Thanks again,

SaintSilver
Quote Reply
Re: a metacrawler? In reply to
I guess you did not try that hard to find the Thread. I did used both Find in Page and also the UBB Search and found the Thread immediately...

Wink

It is located at the following URL:

http://www.gossamer-threads.com/...um3/HTML/003176.html

Regards,



------------------
Eliot Lee
Founder and Editor
Anthro TECH, L.L.C
http://www.anthrotech.com/
info@anthrotech.com
==========================
Coconino Community College
http://www.coco.cc.az.us/
Web Technology
Coordinator
elee@coco.cc.az.us
Quote Reply
Re: a metacrawler? In reply to
Hi,

You can find The Topic above at:

http://www.gossamer-threads.com/...um3/HTML/003176.html

Quote Reply
Re: a metacrawler? In reply to
Sorry, I must not have been paying attention.

Thanks for the help!
SaintSilver