Gossamer Forum
(Advanced Search)
for
Home : Products : Gossamer Links : Discussions :

Prevent unwanted spider ?

Jun 5, 2003, 5:26 AM
brakkar
User (103 posts)
Jun 5, 2003, 5:26 AM
Post #1 of 2
Views: 1276
Shortcut
Quote Reply
Prevent unwanted spider ?
Hi, I suspect I have an unwanted spider that is trying to replicate my links database by following all the links I have in my database.
Its not a big spider like google or altavista, as it ignores my robots text.

Does anyone have advice to deal with such problem ?

Cordially,
Koros
Jun 5, 2003, 5:32 AM
Andy
Veteran / Moderator (18441 posts)
Andy's avatar
Jun 5, 2003, 5:32 AM
Post #2 of 2
Views: 1201
Shortcut
Quote Reply
Re: [brakkar] Prevent unwanted spider ? In reply to
Try using .htaccess 'deny'. See the following for details on how to set something like this up;

http://intensemedia.net/...i?cat=htaccess#mojo4

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!