Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Lucene: General

crawling protected pages

 

 

Lucene general RSS feed   Index | Next | Previous | View Threaded


edwardquick at hotmail

Sep 11, 2005, 1:16 PM

Post #1 of 2 (1040 views)
Permalink
crawling protected pages

Hi,

I need to crawl a site that is protected. Is there currently any way to do
this with nutch (i.e. providing a username/password) ?

Thanks,

Ed.


otis_gospodnetic at yahoo

Sep 11, 2005, 9:45 PM

Post #2 of 2 (920 views)
Permalink
Re: crawling protected pages [In reply to]

I don't think there is. I assume you are considering using Nutch. If
so, use nutch-user mailing list instead. You'll get more help there.

Otis

--- Edward Quick <edwardquick[at]hotmail.com> wrote:

> Hi,
>
> I need to crawl a site that is protected. Is there currently any way
> to do
> this with nutch (i.e. providing a username/password) ?
>
> Thanks,
>
> Ed.
>
>
>

Lucene general RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact lists@gossamer-threads.com
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.