jira at apache
Feb 7, 2008, 6:54 AM
Post #1 of 1
(396 views)
Permalink
|
|
[jira] Created: (LUCENE-1168) TermVectors index files can become corrupt when autoCommit=false
|
|
TermVectors index files can become corrupt when autoCommit=false
----------------------------------------------------------------
Key: LUCENE-1168
URL: https://issues.apache.org/jira/browse/LUCENE-1168
Project: Lucene - Java
Issue Type: Bug
Components: Index
Affects Versions: 2.3
Reporter: Michael McCandless
Assignee: Michael McCandless
Fix For: 2.4
Spinoff from this thread:
http://www.gossamer-threads.com/lists/lucene/java-dev/55951
There are actually 2 separate cases here, both only happening when
autoCommit=false:
* First issue was caused by LUCENE-843 (sigh): if you add a bunch of
docs with no term vectors, such that 1 or more flushes happen;
then you add docs that do have term vectors, the tvx file will not
have enough entries (= corruption).
* Second issue was caused by bulk merging of term vectors
(LUCENE-1120 -- only in trunk) and bulk merging of stored fields
(LUCENE-1043, in 2.3), and only shows when autoCommit=false, and,
the bulk merging optimization runs. In this case, the code that
reads the rawDocs tries to read too far in the tvx/fdx files (it's
not really index corruption but rather a bug in the rawDocs
reading).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene
|
