Has anyone tried to import the full Regional category from the DMOZ rdf dump? I have tried many times to import the category into a clean install (new database) but it fails during the table repair. At first, I thought it was my rdf file (maybe corrupt), but it does the same from the main gziped file, and a cut I've made. When doing a repair, the line reads something like:
Regional has {blank} links but is set to 19. Repairing...
(it can't seem to determine the total links)
Then, after running for an hour or two, it gives a:
Structure Error!
This category is the largest DMOZ category (over 700,000 links). All other categories seem to import properly. The problem is when you then do a rebuild search, and it only indexes a little over 300,000 of the links.
Is there a limit as to how many links the software can handle per category?
Sean
Regional has {blank} links but is set to 19. Repairing...
(it can't seem to determine the total links)
Then, after running for an hour or two, it gives a:
Structure Error!
This category is the largest DMOZ category (over 700,000 links). All other categories seem to import properly. The problem is when you then do a rebuild search, and it only indexes a little over 300,000 of the links.
Is there a limit as to how many links the software can handle per category?
Sean
Regional import...