Gossamer Forum
Home : Products : Gossamer Links : Version 1.x :

Open Directory Import - subcategory

Quote Reply
Open Directory Import - subcategory
I recently registered Links SQL and am starting to tinker with it, so forgive me if I am asking silly questions :-)

At: http://www.gossamer-threads.com/scripts/links-sql/links2.htm

It states the following:
Open Directory Import: there is an included script that can import any subcategory of the Open Directory into Links SQL.

I have searched the forums, but could not come up with any specific instructions on how to do this? I have ver 1.13 and would like to use this feature, but dont know where to start. I have found topics related on importing the whole 80 or 450 MB file whichever it is, but that is not what I want to do, I just some spcific categories.

Any instructions or pointers would be greatly appreciated. Thanks in advance.


Quote Reply
Re: Open Directory Import - subcategory In reply to
The script is Parse_RDF.pl in the setup directory.

http://www.postcards.com
FAQ: http://www.postcards.com/FAQ/LinkSQL/

Quote Reply
Re: Open Directory Import - subcategory In reply to
Pugdog, Thanks for the response, I tried to run that file from the web browser which I am sure thats wrong :-), just got an 500 Internal Server Error.

Is there any documentation that a newby to Links SQL to walk me throught the process of importing specific categories? Thanks again

Quote Reply
Re: Open Directory Import - subcategory In reply to
just wanted to bump this topic up and see if there was any documentation on importing. Thanks

Quote Reply
Re: Open Directory Import - subcategory In reply to
You first need to have the copy of the Super_parse file from the /licensed area. I'm not sure if it's included in the new zip or not. It allows running from the .gzip file, without expanding it. And fixes some bugs.

Also, you need to run it from the setup directory.

It expects Links to be installed and running.

you need to set the file permissions on it to 755 - execute, and you need to make sure the #!/path/to/perl is correct for your system.

Then, in the file, there are few lines you edit to fit the categories you want to grab.



http://www.postcards.com
FAQ: http://www.postcards.com/FAQ/LinkSQL/

Quote Reply
Re: Open Directory Import - subcategory In reply to
Okay, so I am currently setting up links sql on my linux box at home, so that I can import the entire dmoz directory, thyen I will clean out what I don't want from the databases, do a mysql dump, then insert them into my servers mysql database.

So, the question is this, the parser asks for a specific categories, what if I want to import the entire thing, would I just leave the categories part blank, or must I insert all the categories into the list, or just all the top categories or is there a special substitution like *.* to import all categories and links.

Thanks
Harrison


"I've got if's pretty good, but that's about it"
Quote Reply
Re: Open Directory Import - subcategory In reply to
Thanks for your detailed response pugdog, I will try it and see if it works

Quote Reply
Re: Open Directory Import - subcategory In reply to
Kinda a mute point at this point since the Parse_RDF.pl file doesn't work anyway, since I m guessing here that dmoz changed their content, I can only parse to the first chosen category, then it gives back a broken pipe error message.

Harrison

"I've got if's pretty good, but that's about it"