Gossamer Forum
Home : Products : Gossamer Links : Discussions :

DMOZ Splitter

Quote Reply
DMOZ Splitter
I just had a bit of spare time before my dinner so wrote a script to split the 1GB DMOZ data file into seperate files. It will parse any category you desire and dump it into a seperate file.

It should be run from the command prompt (if using windows) or a telnet/ssh window (if using *nix).

Usage is pretty simple....

Code:
perl rdf_parse.pl --rdf=/path/to/content.rdf.u8 --out=/path/to/new.file --cat=Top/Arts

Just do:

perl rdf_parse.pl

...and you'll get a summary of options.

Hope someone finds it useful.
Subject Author Views Date
Thread DMOZ Splitter Paul 10661 Jun 19, 2003, 12:50 PM
Post Re: [Paul] DMOZ Splitter
tsingson 10455 Jun 22, 2003, 11:07 AM
Thread Re: [Paul] DMOZ Splitter
Paul 10434 Jun 26, 2003, 6:36 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 10400 Jun 26, 2003, 7:26 AM
Thread Re: [webslicer] DMOZ Splitter
Paul 10382 Jun 26, 2003, 7:35 AM
Post Re: [Paul] DMOZ Splitter
webslicer 10406 Jun 26, 2003, 7:58 AM
Thread Re: [Paul] DMOZ Splitter
tsingson 10355 Jun 26, 2003, 8:13 AM
Thread Re: [tsingson] DMOZ Splitter
Paul 10385 Jun 26, 2003, 11:23 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 10373 Jun 26, 2003, 6:05 PM
Thread Re: [webslicer] DMOZ Splitter
Paul 10366 Jun 27, 2003, 5:55 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 10341 Jun 27, 2003, 8:35 AM
Thread Re: [webslicer] DMOZ Splitter
Paul 10386 Jun 27, 2003, 9:05 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 10335 Jun 27, 2003, 11:18 AM
Thread Re: [webslicer] DMOZ Splitter
Paul 10322 Jun 27, 2003, 11:31 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 10300 Jun 27, 2003, 12:08 PM
Thread Re: [webslicer] DMOZ Splitter
Paul 10321 Jun 27, 2003, 12:11 PM
Thread Re: [Paul] DMOZ Splitter
webslicer 10294 Jun 27, 2003, 12:21 PM
Post Re: [webslicer] DMOZ Splitter
Paul 10279 Jun 27, 2003, 1:38 PM
Thread DMOZ Splitter Duplicate Checker
webslicer 10263 Jun 30, 2003, 11:24 AM
Post Re: [webslicer] DMOZ Splitter Duplicate Checker
webslicer 10100 Jul 13, 2003, 1:49 PM
Thread Re: [webslicer] DMOZ Splitter
Andy 10345 Jun 27, 2003, 11:46 AM
Post Re: [Andy] DMOZ Splitter
webslicer 10304 Jun 27, 2003, 11:59 AM
Thread Re: [Paul] DMOZ Splitter
eljot 10162 Jul 13, 2003, 4:09 AM
Thread Re: [eljot] DMOZ Splitter
Andy 10101 Jul 14, 2003, 1:15 AM
Post Re: [Andy] DMOZ Splitter
eljot 10078 Jul 14, 2003, 3:09 AM