Hello afinlr,

Site maps are utilized for inclusion to major engines such as google and yahoo. They assist the engines in adding all the pages a site contains.

This is the sitemap I use presently:
http://gsitecrawler.com/

At present I am excluding in the below manner:
http://my_domain.com/cgi-bin/add.cgi
http://my_domain.com/cgi-bin/bnbform.cgi
http://my_domain.com/cgi-bin/bookmark.cgi
http://my_domain.com/cgi-bin/browser.cgi
http://my_domain.com/cgi-bin/contact.cgi
http://my_domain.com/cgi-bin/contact_form.cgi
http://my_domain.com/cgi-bin/del_link.cgi
http://my_domain.com/cgi-bin/modify.cgi
http://my_domain.com/cgi-bin/page.php
http://my_domain.com/cgi-bin/postback.cgi
http://my_domain.com/cgi-bin/rate.cgi
http://my_domain.com/cgi-bin/recommend_it.cgi
http://my_domain.com/cgi-bin/review.cgi
http://my_domain.com/cgi-bin/search.cgi
http://my_domain.com/cgi-bin/subscribe.cgi
http://my_domain.com/cgi-bin/user.cgi
http://my_domain.com/cgi-bin/detail_page.cgi
http://my_domain.com/cgi-bin/jump.cgi


Grabbing the detailed pages are the problem when your using jump.cgi to count the clicks to a detailed page.

Hope that makes it clearer for you.


Sandra Roussel
Chonsa Group Design - Fresh Start Housing