Gossamer Forum
Home : Products : Links 2.0 : Customization :

Alternative question

Quote Reply
Alternative question
Some one told me that if you submit your 'www.server.com' to AltaVista, then AltaVista will 'spider' the full website, from root directory to the last file in the last directory:

www.server.com/index.htm
www.server.com/welcome.htm
www.server.com/hello.htm
www.server.com/pub/index.htm
www.server.com/pub/index.txt
www.server.com/users/members.txt
www.server.com/users/pm/rrr/we/mail.htm
... etc.

Is it true?
Is there a similar script somewhere?

Regards,

Pasha

------------------
webmaster@find.virtualave.net
http://find.virtualave.net