Gossamer Forum
Home : Products : Gossamer Links : Discussions :

Obtaining URLs from search engines

Quote Reply
Obtaining URLs from search engines
Can anyone tell me how to go about getting a list of URLs from any of the major search engines without having to copy and paste each one individually? Are there any programs out there that can snif through a search engine and capture all URLs under a specific category or search term?

I checked out DMOZ, but I found that their listings were pretty sparse.
Quote Reply
Re: [bananadan] Obtaining URLs from search engines In reply to
>>
I checked out DMOZ, but I found that their listings were pretty sparse.
<<

Quality not quantity Smile

Did you find the 900MB rdf file?
Quote Reply
Re: [bananadan] Obtaining URLs from search engines In reply to
Hi,

Check out http://www.linkssuite.com/dmoz.htm

Try out the demo and then try importing - I can't import into LinksSQL - error reported below but still waiting for support response.

Cheers,

Ross

*-*-*-*-*-*-*-*-*-*-*
Servicepals.com is an online community for serving and retired military men and women. Visit us at http://www.servicepals.com. Development by Rawnet Limited
*-*-*-*-*-*-*-*-*-*-*
Quote Reply
Re: [servicepals] Obtaining URLs from search engines In reply to
What a great recommendation. Thanks Ross! I only wish this software worked on other search engines.
Quote Reply
Re: [bananadan] Obtaining URLs from search engines In reply to
Well, try their Linkssuite software :

http://www.linkssuite.com/linkssuite.htm

You might also be interested http://www.jimtools.com/extractor/ which I found more stable and reliable than the above.

Hope that helps!!

Ross

*-*-*-*-*-*-*-*-*-*-*
Servicepals.com is an online community for serving and retired military men and women. Visit us at http://www.servicepals.com. Development by Rawnet Limited
*-*-*-*-*-*-*-*-*-*-*