Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Lucene: Java-User
Term Frequency vector consumes memory
 

Index | Next | Previous | View Flat


emailgane at yahoo

Jun 30, 2009, 12:37 AM


Views: 436
Permalink
Term Frequency vector consumes memory

At the end of the day, I used to build the stats of top indexed terms. I enabled term frequency for the single field. It is working fine. I could able to get the top terms and its frequencies. It consumes huge amount of RAM. My index size is 5 GB and has 8 million records. If i didn't enable term vector then i could do index up to 17 GB with 40 million records.

When IndexReader/ Searcher is opened, whether it will load all term vector frequncies?

Consider i have enabled this option and indexed say 5GB, Now i don't want the Reader / Searcher to load term vector. I want to switch off this feature? Is that possible without re-indexing?

Regards
Ganesh
Send instant messages to your online friends http://in.messenger.yahoo.com

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe[at]lucene.apache.org
For additional commands, e-mail: java-user-help[at]lucene.apache.org

Subject User Time
Term Frequency vector consumes memory emailgane at yahoo Jun 30, 2009, 12:37 AM
    Re: Term Frequency vector consumes memory gsingers at apache Jun 30, 2009, 9:18 AM
        Re: Term Frequency vector consumes memory emailgane at yahoo Jun 30, 2009, 10:39 PM
            Re: Term Frequency vector consumes memory gsingers at apache Jul 2, 2009, 5:45 AM

  Index | Next | Previous | View Flat
 
 


Interested in having your list archived? Contact lists@gossamer-threads.com
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.