That will definitely shorten the time I spent on removing duplicate links.
DMOZ Extractor 2 from PJL Technology. It is very easy to extract from DMOZ the categories/sub categories, links (URL) and relevant infomation and it has the option to export to Links 2.0. Files exported to Links 2.0 can be uploaded to LSQL for import into LSQL.
However, it does not have automated process and it requires uploading.
DMOZ Extractor 2 from PJL Technology. It is very easy to extract from DMOZ the categories/sub categories, links (URL) and relevant infomation and it has the option to export to Links 2.0. Files exported to Links 2.0 can be uploaded to LSQL for import into LSQL.
However, it does not have automated process and it requires uploading.