Has anyone got experience with WebStripper?
I just noticed in my apache logs, that somebody using webstripper has downloaded my whole site, including all dynamic pages on the forum. Shouldn't a well behaved robot know that spidering dynamic pages does not make much sense?
Ivan
-----
Iyengar Yoga Resources / GT Plugins
I just noticed in my apache logs, that somebody using webstripper has downloaded my whole site, including all dynamic pages on the forum. Shouldn't a well behaved robot know that spidering dynamic pages does not make much sense?
Ivan
-----
Iyengar Yoga Resources / GT Plugins