Gossamer Forum
Home : Products : Links 2.0 : Customization :

goFetch LinkSpider Does anyone have it ?

Quote Reply
goFetch LinkSpider Does anyone have it ?
It turned out that gofetch website owner closed the site http://lh.links247.net in Jan 2002. No reply to the mod request posted on that forum since July 2000 anyone having the mod please post a working URL. If there is any new MOD which can spider yahoo or DMOZ and include the data in links2 db please let me know.

regards
Dharmanath
Quote Reply
Re: [xego] goFetch LinkSpider Does anyone have it ? In reply to
The owner of this site owed me $120 dollars and ripped me off.
Quote Reply
Re: [Paul] goFetch LinkSpider Does anyone have it ? In reply to
can't help you on that my friend. it might be wise to write of the debt which is more than 1 year old since that person has totally vanished in thin air.

Don't know the personality trails of that individual but as per posting on other sites Go Fetch 2.2 was considered a good piece of software.

regards
Dharmanath
Quote Reply
Re: [xego] goFetch LinkSpider Does anyone have it ? In reply to
Towards my above posting, I managed to get the directory listings i wanted from DMOZ using the software "DMOZ Extractor". Since DMOZ has recently changed their page layouts the software failed for auto extraction so had to manually click on over 2000 pages and then click on the parsing button.

Using the software is not just about paying to the software guys and getting all in your lap
* the category structure needs to be changed to suite Links 2.0 i.e: the ":" replaced with "/" in category.db and links.db which further complicate the issue since ":" in title and description also gets changed which is a big headache to clear,
* a lot of empty missing sub-categories need to be found and added to the db otherwise the tree will not function.
* the LinksIII GT converter add additional 2 empty fields which need to be deleted from links.db or the "build all" will go haywire
* I managed to generate 16,000 unique links from DMOZ with over 2200 categories but while testing on my PC for file generation it gives me script timeout and sometime deletes 90% of the links in links.db where i had to resort to making the file read only.

* The script time out still exists. Is Links2.0 capable of handling 18000 records?
* The process of building the pages take 100% CPU utilzation on my PC for over 15 minutes and then fires time out, can i control the process ?
* I need to secure the pages from bandwidth stealers, some of the suggestions on the forums don't work using the HTTP-REFERER.

Suggestions will be highly appreciated.

regards
dharmanath
Quote Reply
Re: [xego] goFetch LinkSpider Does anyone have it ? In reply to
Try getting in contact with the authors. They may not be aware of the DMOZ change, so letting them know will allow them to start making changes to suite these problems.

Cheers

Andy (mod)
andy@ultranerds.co.uk


IMPORTANT: I've now moved to ultranerds.co.uk, and the .com will no longer work!
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package (plugins total "value" $3,325 & rising, for just $350)| GLinks ULTRA Package PRO (plugins total "value" $5,625 & rising, for just $500)
Support Forum | Links SQL Plugins | DMOZ Dumps | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Compare our different Plugin packages *new* Free CSS Templates