Gossamer Forum
Home : Products : Gossamer Links : Discussions :

IMPORTING DMOZ....

Quote Reply
IMPORTING DMOZ....
I've uploaded content.rdf.u8.gz on my site, and I've lunched this command trought telnet:
perl nph-import.cgi --import="RDF" --source="/home/site/mysite.it/cgi-bin/dmoz/content.rdf.u8.gz" --destination"/home/site/mysite.it/cgi-bin/admin/defs" --create-columns --create-missing-categories --rdf-category="Top/Adult" --rdf-user="Admin" --rdf-add-date="2002-01-01" --whith-gzip

But when it processing I've this error:
Unknown option: destination/home/site/mysite.it/cgi-bin/admin/defs
Unknown option: whith-gzip
Content-type: text/html
<p><font face='Tahoma,Arial,Helvetica' size=2>A fatal error has occured:</font></p><blockquote><pre>GT::SQL (28946):
Wrong argument passed to this subroutine.
Usage: The defs directory '' does not exist, or is not a directory. at /home/site/mysite.it/cgi-bin/admin/Links/Import/RDFS2.pm line 69.
</pre></blockquote><p><font face='Tahoma,Arial,Helvetica' size=2>Please enable
debugging in setup for more details.</font></p>GT::SQL (28946): Wrong argument passed to this subroutine.
Usage: The defs directory '' does not exist, or is not a directory. at /home/site/mysite.it/cgi-bin/admin/Links/Import/RDFS2.pm line 69.

Why ???
Someone can Help me???? Crazy


Thanks in Advance
Bye From Italy

Last edited by:

fabio: Feb 17, 2002, 6:50 AM
Quote Reply
Re: [fabio] IMPORTING DMOZ.... In reply to
You should really have added this as a reply to the original thread to keep things clear.

Look at what you have:

destination"/home/site/mysite.it/cgi-bin/admin/defs"

Go back to the other thread to see how it should be entered.
Quote Reply
Re: [RedRum] IMPORTING DMOZ.... In reply to
Where is my ERROR ????
U Can't help me??


Thanks in Advance
Bye From Italy
Quote Reply
Re: [fabio] IMPORTING DMOZ.... In reply to
http://www.gossamer-threads.com/...;;page=unread#unread

Look at the suggested example and compare it to what you typed.

destination"/home/site/mysite.it/cgi-bin/admin/defs"

--destination="/home/site/mysite.it/cgi-bin/admin/defs"

Last edited by:

RedRum: Feb 17, 2002, 7:09 AM
Quote Reply
Re: [fabio] IMPORTING DMOZ.... In reply to
Also look how you spelt --with-gzip...

--whith-gzip
Quote Reply
Re: [RedRum] IMPORTING DMOZ.... In reply to
Ok thanks, I'm trying again.......


Thanks in Advance
Bye From Italy
Quote Reply
Re: [fabio] IMPORTING DMOZ.... In reply to
I don't know if this is exactly what you placed on telnet last line you have whith should be with.

Wayne

In Reply To:
I've uploaded content.rdf.u8.gz on my site, and I've lunched this command trought telnet:
perl nph-import.cgi --import="RDF" --source="/home/site/mysite.it/cgi-bin/dmoz/content.rdf.u8.gz" --destination"/home/site/mysite.it/cgi-bin/admin/defs" --create-columns --create-missing-categories --rdf-category="Top/Adult" --rdf-user="Admin" --rdf-add-date="2002-01-01" --whith-gzip
Quote Reply
Re: [balita] IMPORTING DMOZ.... In reply to
This is what I've placed on telnet:

perl nph-import.cgi --import="RDF" --source="/home/mysite/site/cgi-bin/dmoz/content.rdf.u8.gz" --destination"/home/mysite/site/cgi-bin/admin/defs" --create-columns --create-missing-categories --rdf-category="Top/Adult" --rdf-user="Admin" --rdf-add-date="2002-01-01" --with-gzip

And This is the error:

Unknown option: destination/home/mysite/site/cgi-bin/admin/defs
Option with-gzip requires an argument
Content-type: text/html <p><font face='Tahoma,Arial,Helvetica' size=2>A fatal error has occured:</font></p><blockquote><pre>GT::SQL (6249): Wrong argument passed to this subroutine. Usage: The defs directory '' does not exist, or is not a directory. at /home/mysite/site/cgi-bin/admin/Links/Import/RDFS2.pm line 69.
</pre></blockquote><p><font face='Tahoma,Arial,Helvetica' size=2>Please enable debugging in setup for more details.</font></p>
GT::SQL (6249): Wrong argument passed to this subroutine. Usage: The defs directory '' does not exist, or is not a directory. at /home/mysite/site/cgi-bin/admin/Links/Import/RDFS2.pm line 69.


Someone can help me ????


Thanks in Advance
Bye From Italy
Quote Reply
Re: [fabio] IMPORTING DMOZ.... In reply to
You didn't copy it properly again.

>>
--destination"/home/mysite/site/cgi-bin/admin/defs"
<<

It should be:

--destination="/home/mysite/site/cgi-bin/admin/defs"
Quote Reply
Re: [RedRum] IMPORTING DMOZ.... In reply to
Ok thanks, Works Fine !!!!
And now I want know how I can import all Dmoz Links ???
Witch category I must set ???
--rdf-category="ALL DMOZ"


Thanks in Advance
Bye From Italy

Last edited by:

fabio: Feb 18, 2002, 7:34 AM
Quote Reply
Re: [fabio] IMPORTING DMOZ.... In reply to
Setting to 'Top' on its own should work. Make sure your on a good server though (most definatly a dedicated server)...otherwise your server admin will not be happy Wink

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [fabio] IMPORTING DMOZ.... In reply to
Hi,

I'm doing that right now.... the command I used was:

Code:
/www/dmoz/cgi-bin/LinkSQL/admin/nph-import.cgi --import RDF --source="./content.rdf.gz" \
--destination="/www/dmoz/cgi-bin/LinkSQL/admin/defs" \
--create-missing-categories \
--rdf-category="Top" \
--rdf-destination="/" \
--with-gzip="/usr/local/bin/gzip" \
--rdf-user="admin" \
--rdf-add-date="2002-01-01"




This machine is not on the Internet any more, so these are the actual paths I used.

It's been running for about 5 hours now, averaging beteen 80,000 and 90,000 links per hour import.

I've not 'repaired' tables while it's running, but the dynamic view of the site, and the "browse" features show the import is proceeding as well as can be expected :)

Next will come "verify" <G> I expect that to take all week ;)


BTW: I download content.rdf.u8.gz as content.rdf.gz just for historical reasons. Make sure you get the current dump! content.rdf.gz hasn't been updated in a year :)


PUGDOG� Enterprises, Inc.

The best way to contact me is to NOT use Email.
Please leave a PM here.

Last edited by:

pugdog: Feb 18, 2002, 12:54 PM
Quote Reply
Re: [pugdog] IMPORTING DMOZ.... In reply to
In case anyone is wondering, adding the:

--rdf-update \

Parameter cut the import speed by about half.

I had my windows session crash, and I had to reboot, so the process terminated.

Adding nohup _BEFORE_ the .../nph-import.cgi command line would have solved that problem.

That pipes output to the file nohup.out, but if your session disconnects, the process will still run. (theoretically).

It's at least better than risking losing your connection.

I figured on my local network I was ok, but then my machine crashed. Just can't win with windows.


PUGDOG� Enterprises, Inc.

The best way to contact me is to NOT use Email.
Please leave a PM here.
Quote Reply
Re: [pugdog] IMPORTING DMOZ.... In reply to
I want Import only this category:
Top: World: Italiano: Affari: Aziende
but I don't know the real name of this directory
I think that is Top/Regional/Italy ......
Someone can help me????


Thanks in Advance
Bye From Italy
Quote Reply
Re: [fabio] IMPORTING DMOZ.... In reply to
Go to dmoz and browse :)