Some one told me that if you submit your 'www.server.com' to AltaVista, then AltaVista will 'spider' the full website, from root directory to the last file in the last directory:
www.server.com/index.htm
www.server.com/welcome.htm
www.server.com/hello.htm
www.server.com/pub/index.htm
www.server.com/pub/index.txt
www.server.com/users/members.txt
www.server.com/users/pm/rrr/we/mail.htm
... etc.
Is it true?
Is there a similar script somewhere?
Regards,
Pasha
------------------
webmaster@find.virtualave.net
http://find.virtualave.net
www.server.com/index.htm
www.server.com/welcome.htm
www.server.com/hello.htm
www.server.com/pub/index.htm
www.server.com/pub/index.txt
www.server.com/users/members.txt
www.server.com/users/pm/rrr/we/mail.htm
... etc.
Is it true?
Is there a similar script somewhere?
Regards,
Pasha
------------------
webmaster@find.virtualave.net
http://find.virtualave.net

