goksron at gmail
Jun 5, 2012, 8:57 PM
Post #2 of 2
(205 views)
Permalink
|
|
Re: RAMDirectory with FSDirectory merging Versus large mergeFactor and RAMBufferSizeMB
[In reply to]
|
|
Ramdirectory is no longer an interesting technique for this. It makes
garbage collection do a lot of work. With memory-mapped directory the
data is cached by the OS instead of Java, and OS is very good at this.
TieredMergePolicy is much smarter about time spent merging segments.
Lucene In Action 2 might be more help than a 6-year-old book :)
On Mon, Jun 4, 2012 at 12:47 AM, Maxim Terletsky <sxamt [at] yahoo> wrote:
> Hi guys,
> There are two approaches I see in Lucene In Action about speeding up the indexing process.
>
> 1) Simply increase the mergeFactor and RAMBufferSizeMB.
> 2) Using RAMDirectory as a buffer (perhaps even several in parallel) and later merging it using addIndexes to FSDirectory.
>
> So my question is the following:
> In case I have only 1 thread with RAMDirectory - is that pretty much the same as method 1? Since it's in memory anyhow for large mergeFactor and large RAMBufferSizeMB.
>
> Maxim
>
>
> ________________________________
--
Lance Norskog
goksron [at] gmail
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe [at] lucene
For additional commands, e-mail: java-user-help [at] lucene
|
