Mailing List Archive: Lucene: General

RAM or File?

Index | Next | Previous | View Threaded

ted.dunning at gmail

May 26, 2009, 2:01 PM

Post #1 of 3 (834 views)
Permalink

RAM or File?

What is the current received wisdom regarding the use of a ram-based or
file-based retrieval?

Will file-based retrieval match ram based speed after sufficient warmup and
assuming that the java memory footprint is kept small to allow maximal OS
caching?

--
Ted Dunning, CTO
DeepDyve

yonik at lucidimagination

May 26, 2009, 2:04 PM

Post #2 of 3 (764 views)
Permalink

Re: RAM or File? [In reply to]

On Tue, May 26, 2009 at 5:01 PM, Ted Dunning <ted.dunning [at] gmail> wrote:
> Will file-based retrieval match ram based speed after sufficient warmup and
> assuming that the java memory footprint is kept small to allow maximal OS
> caching?

Yes, that's what we've seen.

-Yonik
http://www.lucidimagination.com

otis_gospodnetic at yahoo

May 26, 2009, 2:31 PM

Post #3 of 3 (761 views)
Permalink

Re: RAM or File? [In reply to]

Yes. I remember having a very hard time showing that RAMDirectory is faster than FSDirectory back in 2004 while writing Lucene in Action No. 1. If you run the unit test that's supposed to show it, I think you'll see this.

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch

----- Original Message ----
> From: Ted Dunning <ted.dunning [at] gmail>
> To: general [at] lucene
> Sent: Tuesday, May 26, 2009 5:01:47 PM
> Subject: RAM or File?
>
> What is the current received wisdom regarding the use of a ram-based or
> file-based retrieval?
>
> Will file-based retrieval match ram based speed after sufficient warmup and
> assuming that the java memory footprint is kept small to allow maximal OS
> caching?
>
> --
> Ted Dunning, CTO
> DeepDyve

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads