Gossamer Forum
Home : General : Chit Chat :

DMOZ=DEADLINKS?

Quote Reply
DMOZ=DEADLINKS?
Have you noticed that the data on DMOZ has quite a few dead links in it?

It is running about 1 in 10 currently on the data I extracted.

Are the humans not there anymore? hehehehe
Quote Reply
Re: [Teambldr] DMOZ=DEADLINKS? In reply to
Actually I have found the Canadian directory on DMOZ to be worse than 1 in 10. I would estimate some of the sub categories (ones which had moderators too I might add) were about a 1/3 dead or incorrectly categorized.

Thats where our sites and moderates come to work!Cool


http://www.iuni.com/...tware/web/index.html
Links Plugins
Quote Reply
Re: [Ian] DMOZ=DEADLINKS? In reply to
You know, I am working on rechecking and I have found that the dead rate has moved from about 1 in 10 to 1 in 15 so far.

I wonder if EDITORS would like to have control of this tool based upon their areas of control? (EM) Wink
Quote Reply
Re: [Teambldr] DMOZ=DEADLINKS? In reply to
Yeah..a validation thing would be cool in the EM Smile Maybe a green light, and a red light...next to links that, checked in real time.

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] DMOZ=DEADLINKS? In reply to
Or maybe after the validate was ran by the admin it would show those links which need the work done to them on the editor browser page using a call from the EM plugin?

IE:

Links that need editor assistance:
Category Name
Link ID/Link URL Hyperlinked/Actions (modify/delete)
Link ID/Link URL Hyperlinked/Actions (modify/delete)
etc...

Hey Ian! I think we have a GOOD one here!Wink
Quote Reply
Re: [Teambldr] DMOZ=DEADLINKS? In reply to
Maybe we should move these ideas to the EM plugin threadSmile.

One day I will be able to start work on it again.

I find that some editors always check for new links in their areas, but other never do, despite posting announcements, how-tows and reminders.

Maybe your light idea would help!

Great ideas guys!


http://www.iuni.com/...tware/web/index.html
Links Plugins
Quote Reply
Re: [Ian] DMOZ=DEADLINKS? In reply to
The ratio is now down to about 1 in 30.

It seems that a lot of the dead links were seen as dead by the verify tool but when ran again were OK.
Quote Reply
Re: [Teambldr] DMOZ=DEADLINKS? In reply to
Yes, I have personally stopped using the verify tool. I find that editors do a better job, since as you pointed out, they are not necessarily in a permanent "bad status" situation. Also, once which come up good in the verify, can be scams. Like I had one site which submitted as a valid site, but a few weeks later put a load of porn on it, which was their original intention. I also had a casino site do the same before that.

The verify is great for categories which don't have editors though, beacuse what alternative is their, sifting though all the links yourself?


http://www.iuni.com/...tware/web/index.html
Links Plugins
Quote Reply
Re: [Ian] DMOZ=DEADLINKS? In reply to
I wonder if a keyword spider combined with the validate function would do the trick?
Quote Reply
Re: [Teambldr] DMOZ=DEADLINKS? In reply to
It might. It would be a much slower process, but at least there might be some automation to it.

A check for change in the sites content based on the meta information is a nice way of doing it, I guess it would then flag the site for further (manual) scrutiny if there was a change. Hmmm, sounds like something for toolbox to be honest, I could use this too.


http://www.iuni.com/...tware/web/index.html
Links Plugins
Quote Reply
Re: [Ian] DMOZ=DEADLINKS? In reply to
Or searching for non acceptable materials.
Quote Reply
Re: [Teambldr] DMOZ=DEADLINKS? In reply to
Yes, one could have a list of phrases which cause the "bad phrase found" flag to go off.

Obvoisuly single word list would not suffice, as "xxx" can be beer, cool movies (not porno), and so on.


http://www.iuni.com/...tware/web/index.html
Links Plugins
Quote Reply
Re: [Ian] DMOZ=DEADLINKS? In reply to
Ahhh...good point.
Quote Reply
Re: [Ian] DMOZ=DEADLINKS? In reply to
Did someone mention beer and porno? Laugh Anyway, I never thought about someone doing that. I guess it never crossed my mind that someone would enter a legit title and description of a site and it turn out to be a porn site. How would you come up with a list of bad phrases? Do we need to find someone with a very dirty mind to compile one for us?

Sean

Last edited by:

SeanP: Aug 14, 2002, 1:54 PM
Quote Reply
Re: [SeanP] DMOZ=DEADLINKS? In reply to
Hmm, yeah we do need such a person and such a list. How could we ever find that? LOL


http://www.iuni.com/...tware/web/index.html
Links Plugins
Quote Reply
Re: [Ian] DMOZ=DEADLINKS? In reply to
Yeah. If you'd like to contribute to the list, please post your dirty phrases here... LaughLaughLaugh

Last edited by:

SeanP: Aug 14, 2002, 2:02 PM
Quote Reply
Re: [SeanP] DMOZ=DEADLINKS? In reply to
Wheres Paul when you need him? (j/k) Laugh

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] DMOZ=DEADLINKS? In reply to
Be thankful he didn't ask for a list of TOSsers Sly