Will the spider create duplicate links, if it picks up a link to enter in the data base that is a duplicate will it detect it as a duplicat or will it enter duplicate links that I would have to delete later?

How can I prevent someone from spidering mysite and copying all my links?

Thanks