Gossamer Forum
Home : Products : Gossamer Links : Discussions :

DMOZ Splitter

Quote Reply
DMOZ Splitter
I just had a bit of spare time before my dinner so wrote a script to split the 1GB DMOZ data file into seperate files. It will parse any category you desire and dump it into a seperate file.

It should be run from the command prompt (if using windows) or a telnet/ssh window (if using *nix).

Usage is pretty simple....

Code:
perl rdf_parse.pl --rdf=/path/to/content.rdf.u8 --out=/path/to/new.file --cat=Top/Arts

Just do:

perl rdf_parse.pl

...and you'll get a summary of options.

Hope someone finds it useful.
Subject Author Views Date
Thread DMOZ Splitter Paul 13405 Jun 19, 2003, 12:50 PM
Post Re: [Paul] DMOZ Splitter
tsingson 13167 Jun 22, 2003, 11:07 AM
Thread Re: [Paul] DMOZ Splitter
Paul 13148 Jun 26, 2003, 6:36 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 13105 Jun 26, 2003, 7:26 AM
Thread Re: [webslicer] DMOZ Splitter
Paul 13087 Jun 26, 2003, 7:35 AM
Post Re: [Paul] DMOZ Splitter
webslicer 13110 Jun 26, 2003, 7:58 AM
Thread Re: [Paul] DMOZ Splitter
tsingson 13062 Jun 26, 2003, 8:13 AM
Thread Re: [tsingson] DMOZ Splitter
Paul 13102 Jun 26, 2003, 11:23 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 13082 Jun 26, 2003, 6:05 PM
Thread Re: [webslicer] DMOZ Splitter
Paul 13076 Jun 27, 2003, 5:55 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 13052 Jun 27, 2003, 8:35 AM
Thread Re: [webslicer] DMOZ Splitter
Paul 13099 Jun 27, 2003, 9:05 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 13044 Jun 27, 2003, 11:18 AM
Thread Re: [webslicer] DMOZ Splitter
Paul 13028 Jun 27, 2003, 11:31 AM
Thread Re: [Paul] DMOZ Splitter
webslicer 13015 Jun 27, 2003, 12:08 PM
Thread Re: [webslicer] DMOZ Splitter
Paul 13026 Jun 27, 2003, 12:11 PM
Thread Re: [Paul] DMOZ Splitter
webslicer 13002 Jun 27, 2003, 12:21 PM
Post Re: [webslicer] DMOZ Splitter
Paul 12983 Jun 27, 2003, 1:38 PM
Thread DMOZ Splitter Duplicate Checker
webslicer 12969 Jun 30, 2003, 11:24 AM
Post Re: [webslicer] DMOZ Splitter Duplicate Checker
webslicer 12811 Jul 13, 2003, 1:49 PM
Thread Re: [webslicer] DMOZ Splitter
Andy 13054 Jun 27, 2003, 11:46 AM
Post Re: [Andy] DMOZ Splitter
webslicer 13009 Jun 27, 2003, 11:59 AM
Thread Re: [Paul] DMOZ Splitter
eljot 12867 Jul 13, 2003, 4:09 AM
Thread Re: [eljot] DMOZ Splitter
Andy 12810 Jul 14, 2003, 1:15 AM
Post Re: [Andy] DMOZ Splitter
eljot 12787 Jul 14, 2003, 3:09 AM