Gossamer Forum
Home : Products : Gossamer Links : Discussions :

Re: [RedRum] New DMOZ Dumps....

Quote Reply
Re: [RedRum] New DMOZ Dumps.... In reply to
Yeah, quite amazing huh? :-/

It download the database from DMOZ. Decompresses it, then cuts it into 17 smaller categories (emailing me when each section is done) so that I can do the nph-import's faster. Then goes through each category and imports them, then zip's them up, and then I get an email after that to. At the end of it all I get another email with all the stats of how long each thing took to do; e.g;

Main RDF File Dump (download and decompress);


Cut out Adults - Took 58
Cut out Arts - Took 161
Cut out Business - Took 166
Cut out Computers - Took 146
Cut out Games - Took 128
Cut out Health - Took 140
Cut out Home - Took 137
Cut out News - Took 151
Cut out Recreation - Took 188
Cut out Reference - Took 182
Cut out Regional - Took 599
Cut out Science - Took 321
Cut out Shopping - Took 347
Cut out Society - Took 419
Cut out Sports - Took 387
Cut out World - Took 660
Cut out Kids and Teens - Took 414

I'm quite proud of it Smile


Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Subject Author Views Date
Thread New DMOZ Dumps.... Andy 3210 Jan 14, 2002, 12:17 PM
Thread Re: [AndyNewby] New DMOZ Dumps....
Paul 3059 Jan 14, 2002, 12:42 PM
Thread Re: [RedRum] New DMOZ Dumps....
Andy 3101 Jan 14, 2002, 12:47 PM
Thread Re: [AndyNewby] New DMOZ Dumps....
Paul 3046 Jan 14, 2002, 1:12 PM
Thread Re: [RedRum] New DMOZ Dumps....
Andy 3069 Jan 14, 2002, 1:16 PM
Thread Re: [AndyNewby] New DMOZ Dumps....
Paul 3031 Jan 14, 2002, 1:16 PM
Thread Re: [RedRum] New DMOZ Dumps....
Andy 3068 Jan 14, 2002, 1:22 PM
Thread Re: [AndyNewby] New DMOZ Dumps....
Paul 3042 Jan 14, 2002, 1:29 PM
Thread Re: [RedRum] New DMOZ Dumps....
Andy 3099 Jan 14, 2002, 1:32 PM
Post Re: [AndyNewby] New DMOZ Dumps....
Andy 3008 Jan 16, 2002, 12:01 AM