Hi everyone,

For the last year, I've been looking for a URL spider to go out on the web and build a links.db based on my targeted keywords. In other words, for me, I specify the word "Amiga", tell it to start at Altavista, and let it go...

About six months ago, I found such a critter at Innerprise ( http://www.innerprise.net ). It output in it's own format, but I built a converter that sorta worked to create a links.db formatted file from his "out.txt"...

After a while, converting the file got kind of annoying, so I opened up talks with Greg (the author) to see if he would add a series of options to URL Spider Pro allowing us to output directly in Links 2.0 format.

He agreed, I've been working closely with him over the last few days to beta test it and I'm happy to say it works fabulously!

You specify your terms, specify a starting site, hit Index and come back to find a links.db with hundreds of ready-made links in it matching your criteria. Upload and go...

The one drawback to the current version is that you have to specify one category for the new links to be put in, then move them manually. (but I'm sure most of us would prefer to see what we're putting into our db anyway, right?) Then you create a category (I used "Import") that matches the name you gave URL Spider, and it imports all the links for your enjoyment...

I know, this sounds like I must be working for Innerprise, and I'm sorry to disappoint, but I don't. I'm just a registered user for both Links and URL Spider who's REALLY excited to be able to expand my database almost immediately without having to go through and enter links one at a time...



------------------
Wayne Hunt
Amiga.org
http://www.amiga.org

I forgot, that's version 1.7 (to be released today) not the older 1.5 version listed on the site.

------------------
Wayne Hunt
Amiga.org
http://www.amiga.org

Joe,

I hadn't even thought of validate.db.. That works even better... I just know that I've got "require META Tag Description" turned on. I've gone through 90000 links, and it's showing 1% progress on the keyword "amiga".

This is going to be great! Unless of course I add so many links that a Build/staggered times out... There are worse problems to have... ;-)




------------------
Wayne Hunt
Amiga.org
http://www.amiga.org

Oh Man...You've Made My Day!!!

I have been trying to find this same kind of script for a couple of week now. Even looking at modifying one script I found, but dreading it.

I am going to have to give this a try right away.

Thanks for the info,

Joe

Yo Wayne,

VERY NICE...

I've been toying with this program and it is working out beautifully. While the output of the Links DB doesn't take into account any mods, some simple find & replace commands will take care of that.

Otherwise, I think I will load the DB as my validate.db file so I can assign second categories and do some other tweaking. Even with that work ahead, it is still going to save me a HUGE amount of time.

Everybody else...give this thing a try!

Thanks again,

Joe