Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Lucene: Java-Dev

How effcient is IndexReader?

 

 

Lucene java-dev RSS feed   Index | Next | Previous | View Threaded


blazingwolf7 at gmail

Jul 7, 2008, 1:22 AM

Post #1 of 2 (142 views)
Permalink
How effcient is IndexReader?

Hi,

I want to use a Reader to read a document everytime a matching document is
found during search time. So basically, everytime during the calculation of
the score for a document, I will use the reader and retrieve some
information from the index. Will this lower the searching performance?

I mean, the file involve will be millions. Will this way be efficient or
should I find some other way to retreive this information?
--
View this message in context: http://www.nabble.com/How-effcient-is-IndexReader--tp18312100p18312100.html
Sent from the Lucene - Java Developer mailing list archive at Nabble.com.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe[at]lucene.apache.org
For additional commands, e-mail: java-dev-help[at]lucene.apache.org


lucene at mikemccandless

Jul 7, 2008, 3:54 AM

Post #2 of 2 (129 views)
Permalink
Re: How effcient is IndexReader? [In reply to]

If the thing you are retrieving per doc is a stored field or a term
vector, and you're talking about millions of docs, this will likely be
too slow, unless your entire index can fit in the OS's IO cache.

This use case is probably a good fit for column-stride fields:

https://issues.apache.org/jira/browse/LUCENE-1231

... which is still in progress.

Mike

blazingwolf7 wrote:

>
> Hi,
>
> I want to use a Reader to read a document everytime a matching
> document is
> found during search time. So basically, everytime during the
> calculation of
> the score for a document, I will use the reader and retrieve some
> information from the index. Will this lower the searching performance?
>
> I mean, the file involve will be millions. Will this way be
> efficient or
> should I find some other way to retreive this information?
> --
> View this message in context: http://www.nabble.com/How-effcient-is-IndexReader--tp18312100p18312100.html
> Sent from the Lucene - Java Developer mailing list archive at
> Nabble.com.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe[at]lucene.apache.org
> For additional commands, e-mail: java-dev-help[at]lucene.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe[at]lucene.apache.org
For additional commands, e-mail: java-dev-help[at]lucene.apache.org

Lucene java-dev RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact lists@gossamer-threads.com
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.