Gossamer Forum
Quote Reply
TLD's and spider
I have a client that is about to be very angry with me if I cannot get this to work:

I am trying to modify the spider to where it will stay on and only index .edu domains. The problem I am having is when queu http://www.searchedu.com, I get the casino banners which are indexed, which lead to other sites I don't need. Is there any way to modify the spider where it only stays on .edu domains?

</not a clue>
Subject Author Views Date
Thread TLD's and spider Dinky 4774 Mar 13, 2002, 4:08 AM
Thread Re: [Kilroy] TLD's and spider
Andy 4697 Mar 13, 2002, 4:58 AM
Thread Re: [AndyNewby] TLD's and spider
Paul 4680 Mar 13, 2002, 5:05 AM
Thread Re: [RedRum] TLD's and spider
Andy 4675 Mar 13, 2002, 5:10 AM
Thread Re: [AndyNewby] TLD's and spider
Paul 4669 Mar 13, 2002, 5:35 AM
Thread Re: [RedRum] TLD's and spider
Andy 4684 Mar 13, 2002, 5:39 AM
Thread Re: [AndyNewby] TLD's and spider
Dinky 4682 Mar 13, 2002, 6:39 AM
Thread Re: [Kilroy] TLD's and spider
Paul 4673 Mar 13, 2002, 7:30 AM
Thread Re: [RedRum] TLD's and spider
Dinky 4676 Mar 13, 2002, 8:50 AM
Post Re: [Kilroy] TLD's and spider
Aki 4618 Mar 23, 2002, 11:11 AM