Mailing List Archive: Lucene: Java-Dev

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order

Index | Next | Previous | View Threaded

jira at apache

Nov 20, 2009, 9:40 AM

Post #1 of 21 (660 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780670#action_12780670 ]

Yonik Seeley commented on LUCENE-2086:
--------------------------------------

bq. for better locality for the disk heads

It's not just the disk heads, right?
I assumed the majority of the benefit was due to the cached TermEnum scan (instead of a seek) in TermInfosReader.get()

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 20, 2009, 10:04 AM

Post #2 of 21 (642 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780680#action_12780680 ]

Michael McCandless commented on LUCENE-2086:
--------------------------------------------

Ahh, you're right, so long as your deletes are within the same index block (128 terms in length), we avoid the binary search through the terms index and simply scan within the block. Though, you need relatively high density of deletions to see that. Also, no matter what when you cross an indexed term, the binary search will be done. I'll genericize the language in the CHANGES entry.

And actually this reminds to go make sure the flex branch is doing this optimization too...

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 20, 2009, 10:08 AM

Post #3 of 21 (642 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780682#action_12780682 ]

Michael McCandless commented on LUCENE-2086:
--------------------------------------------

OK I changed changes entry to:

* LUCENE-2086: When resolving deleted terms, do so in term sort order
for better performance (Bogdan Ghidireac via Mike McCandless)

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 20, 2009, 10:14 AM

Post #4 of 21 (641 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780685#action_12780685 ]

Yonik Seeley commented on LUCENE-2086:
--------------------------------------

bq. Though, you need relatively high density of deletions to see that.

Yep, but re-indexing a whole bunch of documents is a common case - and that will give a very high density (often consecutive terms).
Also, it may be a complete index build / rebuild, where all the terms will be consecutive. Solr, for instance, can't tell if there are any duplicates when building an index from scratch, so it must use update(). There is a way to tell Solr not to enforce duplicate overwriting (overwrite=false param) but I doubt many people do that, and it risks user error (using it when there are dups in the docs being added, or already in the index).

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 20, 2009, 10:24 AM

Post #5 of 21 (631 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780690#action_12780690 ]

Michael McCandless commented on LUCENE-2086:
--------------------------------------------

Excellent, so this is an important optimization! I'll commit shortly...

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 20, 2009, 10:30 AM

Post #6 of 21 (635 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780698#action_12780698 ]

Tim Smith commented on LUCENE-2086:
-----------------------------------

any chance this can go into 3.0.0 or a 3.0.1?

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 20, 2009, 10:34 AM

Post #7 of 21 (636 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780700#action_12780700 ]

Michael McCandless commented on LUCENE-2086:
--------------------------------------------

bq. any chance this can go into 3.0.0 or a 3.0.1?

I don't think it should be backported (it's an optimization). Generally we [should] only back port bug fixes.

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 20, 2009, 10:36 AM

Post #8 of 21 (630 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780701#action_12780701 ]

Tim Smith commented on LUCENE-2086:
-----------------------------------

i've seen the deletes dominating commit time quite often, so obviously it would be very useful to be able to absorb this optimization sooner than later (whats the timeframe for 3.1?)

otherwise i'll have to override the classes involved and pull in this patch (never like this approach myself)

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 20, 2009, 10:40 AM

Post #9 of 21 (634 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780703#action_12780703 ]

Jason Rutherglen commented on LUCENE-2086:
------------------------------------------

bq. I don't think it should be backported (it's an optimization). Generally we [should] only back port bug fixes.

It doesn't break backwards compatibility and it's well under the hood so it seems like something that go into a sub decimal release?

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 20, 2009, 10:50 AM

Post #10 of 21 (638 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780706#action_12780706 ]

Michael McCandless commented on LUCENE-2086:
--------------------------------------------

bq. i've seen the deletes dominating commit time quite often, so obviously it would be very useful to be able to absorb this optimization sooner than later (whats the timeframe for 3.1?)

I'm not sure how much gain you can expect from this patch (there are
many factors involved) -- maybe try it & report back?

Not sure what the timeframe is for 3.1 at this point...

bq. otherwise i'll have to override the classes involved and pull in this patch (never like this approach myself)

I understand... you could run with trunk (and report back!) ;)

bq. It doesn't break backwards compatibility and it's well under the hood so it seems like something that go into a sub decimal release?

I know it's tempting to do so, but I think it's important to hold the
line on only back-porting important bug fixes... as innocent as this
change looks, it's always possible I screwed something up, and so
why risk a point release with that? Point releases are supposed to
be as stable as we can possibly make them.

This way the change has plenty of time to "bake" on trunk and if
something is amiss we'll have much more time/attention to catch it.

I'd rather see us release a 3.1 sooner rather than later, instead.

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 20, 2009, 10:53 AM

Post #11 of 21 (634 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780710#action_12780710 ]

Tim Smith commented on LUCENE-2086:
-----------------------------------

bq. maybe try it & report back?

i'll see if i can find some cycles to try this against the most painful use case i have

bq. I'd rather see us release a 3.1 sooner rather than later, instead.

yes please.
I would definitely like to see a more accelerated release cycle (even if less functionality gets into each minor release)

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

markrmiller at gmail

Nov 20, 2009, 10:59 AM

Post #12 of 21 (630 views)
Permalink

Re: [jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

Tim Smith (JIRA) wrote:
> I would definitely like to see a more accelerated release cycle (even if less functionality gets into each minor release)
>
>
>
Heh - everyone has said that before. In principle, we all agree - in
practice ...

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 23, 2009, 12:57 PM

Post #13 of 21 (553 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12781615#action_12781615 ]

Tim Smith commented on LUCENE-2086:
-----------------------------------

Got some performance numbers:

Description of test (NOTE: this is representative of actions that may occur in a running system (not a contrived test)):
* feed 4 million operations (3/4 are deletes, 1/4 are updates (single field))
* commit
* feed 1 million updates (about 1/3 are updates, 2/3/ deletes (randomly selected))
* commit

Numbers:
|| Desc || Old || New ||
| feed 4 million | 56914ms | 15698ms |
| commit 4 million | 9072ms | 14291ms |
| total (4 million) | 65986ms | 29989ms |
| update 1 million | 46096ms | 11340ms |
| commit 1 million | 13501ms | 9273ms |
| total (1 million) | 59597ms | 20613ms |

This shows significant improvements with new patched data (1/3 the time for 1 million, about 1/2 the time for initial 4 million feed)

This means i'm gonna definitely need to incorporate this patch while i'm still on 3.0 (will upgrade to 3.0 as soon as its out, then apply this fix)
Ideally, a 3.0.1 would be forthcoming in the next month or so with this fix so i wouldn't have to maintain this patched overlay of code

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 23, 2009, 2:15 PM

Post #14 of 21 (546 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12781654#action_12781654 ]

Michael McCandless commented on LUCENE-2086:
--------------------------------------------

Hmm these really are sizable gains! Thanks for testing.

I guess since the change is so minor and the gains so sizable we should back port for 3.0.1. If nobody objects I'll do so in a day or two...

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 23, 2009, 2:21 PM

Post #15 of 21 (551 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12781663#action_12781663 ]

Uwe Schindler commented on LUCENE-2086:
---------------------------------------

No problem, you can commit to 3.0 branch as soon as the 3 votes for the release are there and I can release the current artifacts.

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 23, 2009, 2:25 PM

Post #16 of 21 (544 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12781666#action_12781666 ]

Mark Miller commented on LUCENE-2086:
-------------------------------------

No objection, but its an awkward precedent - you can see any bleeding edge user always wanting the latest optimization in the next bug fix release (considering how long you'll likely have to wait for x.n).

But as I'm one that was somewhat pro this for 2.9 (due to some being stuck on 1.4), I won't try and stop it here. I'm a big fan of case by case in general anyway. I agree with your previous comment about trying to keep a bug fix release as stable as possible - and this being a minor change, that would seemt to go along with it - but code is a funny beast, even when dealing with the simple ...

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 23, 2009, 2:37 PM

Post #17 of 21 (550 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12781680#action_12781680 ]

Michael McCandless commented on LUCENE-2086:
--------------------------------------------

Yeah there's an exception to every rule ;) Fast forward a month or two, if we find out I somehow broke 3.0.1 by back-porting this fix, I'll be real grumpy!

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 23, 2009, 2:56 PM

Post #18 of 21 (546 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12781687#action_12781687 ]

Michael McCandless commented on LUCENE-2086:
--------------------------------------------

bq. No problem, you can commit to 3.0 branch as soon as the 3 votes for the release are there and I can release the current artifacts.

BTW can't/won't you cut the tag back on the right revision, anyway? Ie why freeze the 3.0 branch from any backports?

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 23, 2009, 11:16 PM

Post #19 of 21 (541 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12781806#action_12781806 ]

Uwe Schindler commented on LUCENE-2086:
---------------------------------------

Just commit it. It is so simple, so if I respin, it can be in 3.0.0.

I did'nt want to have commits in 3.0, because if I respin a release, I would not be able to only take *some* of the fixes into 3.0.0. That was the reason.

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 24, 2009, 1:40 AM

Post #20 of 21 (535 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12781837#action_12781837 ]

Michael McCandless commented on LUCENE-2086:
--------------------------------------------

{quote}
I did'nt want to have commits in 3.0, because if I respin a release, I would not be able to only take some of the fixes into 3.0.0. That was the reason.

Can you put this also in 2.9.2 if you remove the generics?
{quote}
OK I'll backport...

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.2, 3.0.1, 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

jira at apache

Nov 24, 2009, 5:41 AM

Post #21 of 21 (530 views)
Permalink

[jira] Commented: (LUCENE-2086) When resolving deletes, IW should resolve in term sort order [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12781925#action_12781925 ]

Michael McCandless commented on LUCENE-2086:
--------------------------------------------

Backported to 3.0.x...

2.9.x next.

> When resolving deletes, IW should resolve in term sort order
> ------------------------------------------------------------
>
> Key: LUCENE-2086
> URL: https://issues.apache.org/jira/browse/LUCENE-2086
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.2, 3.0.1, 3.1
>
> Attachments: LUCENE-2086.patch
>
>
> See java-dev thread "IndexWriter.updateDocument performance improvement".

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads