Gossamer Forum: Products: Gossamer Links: Development, Plugins and Globals: Regional/World DMOz imports acting funny....

Oct 25, 2003, 3:19 AM

Andy

Veteran / Moderator (18441 posts)

Oct 25, 2003, 3:19 AM

Post #1 of 3

Shortcut

Regional/World DMOz imports acting funny....

Hi. Has anyone ever managed to get the Regional/World categories from DMOZ imported ok? I've been noticing a lot of funny charachters, such as;

Commerce et í©conomie (8637)

As you can see, that is not right. I've written a perl script to go through a lot of these bad charachters, but I really don't fancy having to run it for every bad charachter in the database Unsure

Cheers

Andy (mod)
andy@ultranerds.co.uk

Nov 17, 2003, 9:58 AM

Andy

Veteran / Moderator (18441 posts)

Nov 17, 2003, 9:58 AM

Post #2 of 3

Shortcut

Re: [Andy] Regional/World DMOz imports acting funny.... In reply to

Think I may have found a fix for this. In SSH, before starting the import, run the following command;

iconv -c -f UTF-8 -t UTF-8 Regional.dump.slice > valid.Regional.dump.slice

Cheers

Andy (mod)
andy@ultranerds.co.uk

Nov 22, 2003, 5:12 AM

Andy

Veteran / Moderator (18441 posts)

Nov 22, 2003, 5:12 AM

Post #3 of 3

Shortcut

Re: [Andy] Regional/World DMOz imports acting funny.... In reply to

I've now written a script (with help for Alex) that uses Unicode::UTF8 to translate these bad charachters. This script now comes as part of the distribution package of my DMOZ_Wizard plugin.

Cheers

Andy (mod)
andy@ultranerds.co.uk