Due to my SSH connection timing out during two imports of the the two largest dmoz categories (and having to start over) I now have 2,000,000 plus duplicates.

I was under the impression that duplicates could be automatically deleted, but now I see, that I have to mark a check box 2 million times.

Ah...there must be a better way.

I could do this through a sql statement fairly easily, however, I wanted to do this through links sql 2 as I assume it takes care of certain things behind the scenes that I might miss.

In the event I have to do this manually, are there any "gotcha's", I have to watch out for? In particular, which tables need to be dropped / truncated?

Keep in mind that my "Browse" selection doesn't work in the Admin panel.

Code is always appreciated!