Gossamer Forum
Quote Reply
TLD's and spider
I have a client that is about to be very angry with me if I cannot get this to work:

I am trying to modify the spider to where it will stay on and only index .edu domains. The problem I am having is when queu http://www.searchedu.com, I get the casino banners which are indexed, which lead to other sites I don't need. Is there any way to modify the spider where it only stays on .edu domains?

</not a clue>
Subject Author Views Date
Thread TLD's and spider Dinky 4753 Mar 13, 2002, 4:08 AM
Thread Re: [Kilroy] TLD's and spider
Andy 4676 Mar 13, 2002, 4:58 AM
Thread Re: [AndyNewby] TLD's and spider
Paul 4660 Mar 13, 2002, 5:05 AM
Thread Re: [RedRum] TLD's and spider
Andy 4655 Mar 13, 2002, 5:10 AM
Thread Re: [AndyNewby] TLD's and spider
Paul 4649 Mar 13, 2002, 5:35 AM
Thread Re: [RedRum] TLD's and spider
Andy 4664 Mar 13, 2002, 5:39 AM
Thread Re: [AndyNewby] TLD's and spider
Dinky 4662 Mar 13, 2002, 6:39 AM
Thread Re: [Kilroy] TLD's and spider
Paul 4653 Mar 13, 2002, 7:30 AM
Thread Re: [RedRum] TLD's and spider
Dinky 4656 Mar 13, 2002, 8:50 AM
Post Re: [Kilroy] TLD's and spider
Aki 4598 Mar 23, 2002, 11:11 AM