Gossamer Forum
Home : Products : Gossamer Links : Discussions :

Re: [Paul] DMOZ Splitter

Quote Reply
Re: [Paul] DMOZ Splitter In reply to
After some serious blood, sweat, tears and bandwidth usage, I've managed to write a script that will fetch the DMOZ content and extract *all* categories heirarchically. This means that it extracts into the following structure....

Code:
Top/
Top/Adult.part.gz # All Top/Adult data.
Top/Adult/Arts.part.gz # All Top/Adult/Arts data
Top/Adult/Business.part.gz # All Top/Adult/Business data

...and so on.

For an example of what I mean, go here....

http://dmoz.perlwhirl.com/

Is anyone interested in me using this script to provide weekly updated content?

Last edited by:

Paul: Jun 26, 2003, 6:36 AM
Subject Author Views Date
Thread DMOZ Splitter Paul 10693 Jun 19, 2003, 12:50 PM
Post Re: [Paul] DMOZ Splitter
tsingson 10487 Jun 22, 2003, 11:07 AM
Thread Re: [Paul] DMOZ Splitter
Paul 10467 Jun 26, 2003, 6:36 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 10433 Jun 26, 2003, 7:26 AM
Thread Re: [webslicer] DMOZ Splitter
Paul 10414 Jun 26, 2003, 7:35 AM
Post Re: [Paul] DMOZ Splitter
webslicer 10438 Jun 26, 2003, 7:58 AM
Thread Re: [Paul] DMOZ Splitter
tsingson 10388 Jun 26, 2003, 8:13 AM
Thread Re: [tsingson] DMOZ Splitter
Paul 10417 Jun 26, 2003, 11:23 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 10405 Jun 26, 2003, 6:05 PM
Thread Re: [webslicer] DMOZ Splitter
Paul 10398 Jun 27, 2003, 5:55 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 10373 Jun 27, 2003, 8:35 AM
Thread Re: [webslicer] DMOZ Splitter
Paul 10418 Jun 27, 2003, 9:05 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 10368 Jun 27, 2003, 11:18 AM
Thread Re: [webslicer] DMOZ Splitter
Paul 10354 Jun 27, 2003, 11:31 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 10332 Jun 27, 2003, 12:08 PM
Thread Re: [webslicer] DMOZ Splitter
Paul 10354 Jun 27, 2003, 12:11 PM
Thread Re: [Paul] DMOZ Splitter
webslicer 10326 Jun 27, 2003, 12:21 PM
Post Re: [webslicer] DMOZ Splitter
Paul 10312 Jun 27, 2003, 1:38 PM
Thread DMOZ Splitter Duplicate Checker
webslicer 10296 Jun 30, 2003, 11:24 AM
Post Re: [webslicer] DMOZ Splitter Duplicate Checker
webslicer 10132 Jul 13, 2003, 1:49 PM
Thread Re: [webslicer] DMOZ Splitter
Andy 10377 Jun 27, 2003, 11:46 AM
Post Re: [Andy] DMOZ Splitter
webslicer 10336 Jun 27, 2003, 11:59 AM
Thread Re: [Paul] DMOZ Splitter
eljot 10194 Jul 13, 2003, 4:09 AM
Thread Re: [eljot] DMOZ Splitter
Andy 10133 Jul 14, 2003, 1:15 AM
Post Re: [Andy] DMOZ Splitter
eljot 10110 Jul 14, 2003, 3:09 AM