Gossamer Forum
Home : Products : Links 2.0 : Discussions :

blocking search engines

Quote Reply
blocking search engines
is there a way to block search engines from viewing one's db...?

it's crazy I can set it so people must log in - but yet SEs can come through :)
Quote Reply
Re: [rayramon] blocking search engines In reply to
What do you mean "viewing one's db" ?

How about robots.txt
Quote Reply
Re: [rayramon] blocking search engines In reply to
Quote:
it's crazy I can set it so people must log in - but yet SEs can come through :)

That's imposible if you are using .htaccess and .htpasswd. Robots.txt files on the other hand, are only suggestions to spiders to not index your site, and they can choose to ignore the file.

--Philip
Links 2.0 moderator
Quote Reply
Re: [sponge] blocking search engines In reply to
but if I use the .htaccess file when legitimate users access the directory holding dbman..they'll be prompted for that pw of the .htacces file and for the pw for dbman....right?
Quote Reply
Re: [rayramon] blocking search engines In reply to
sigh... you don't have to put the protection on your root cgi-bin. just block things like your admin directory.

--Philip
Links 2.0 moderator