Hi
I have been using this great toolfor a while, BUT lately I am getting:
Restricted! on over 70% of the titles I am trying to spider,
My FollowRobotsTxt is set to 0..
Any ideas?
Regards
KaTaBd
Users plug In - Multi Search And Remote Search plug in - WebRing plug in - Muslims Directory
I have been using this great toolfor a while, BUT lately I am getting:
Restricted! on over 70% of the titles I am trying to spider,
My FollowRobotsTxt is set to 0..
Any ideas?
Regards
KaTaBd
Users plug In - Multi Search And Remote Search plug in - WebRing plug in - Muslims Directory