Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Lucene: Java-Dev

[jira] Commented: (LUCENE-2071) Allow updating of IndexWriter SegmentReaders

 

 

Lucene java-dev RSS feed   Index | Next | Previous | View Threaded


jira at apache

Nov 16, 2009, 2:59 PM

Post #1 of 2 (223 views)
Permalink
[jira] Commented: (LUCENE-2071) Allow updating of IndexWriter SegmentReaders

[ https://issues.apache.org/jira/browse/LUCENE-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778624#action_12778624 ]

Michael McCandless commented on LUCENE-2071:
--------------------------------------------

I would rather not open up such an advanced API now. What's the
specific driver (that can't be achieved throw IW's already exposed
APIs)?

Or, at least, take this up in the larger context of the refactoring of
IW / allowing custom subclasses of SR to be used by apps / etc.

> Allow updating of IndexWriter SegmentReaders
> --------------------------------------------
>
> Key: LUCENE-2071
> URL: https://issues.apache.org/jira/browse/LUCENE-2071
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Affects Versions: 2.9.1
> Reporter: Jason Rutherglen
> Priority: Minor
> Fix For: 3.1
>
> Attachments: LUCENE-2071.patch
>
>
> This discussion kind of started in LUCENE-2047. Basically, we'll allow users to perform delete document, and norms updates on SegmentReaders that are handled by IndexWriter.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene


jira at apache

Nov 16, 2009, 3:19 PM

Post #2 of 2 (209 views)
Permalink
[jira] Commented: (LUCENE-2071) Allow updating of IndexWriter SegmentReaders [In reply to]

[ https://issues.apache.org/jira/browse/LUCENE-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778641#action_12778641 ]

Jason Rutherglen commented on LUCENE-2071:
------------------------------------------

I suspect there's apps out in the wild that could use this (I
recall some of the LinkedIn code could find this useful,
something like Zoie that already has deletes calculated in a doc
set, and I doubt it's the only installation with this use case).
Solr has pre-calculated docsets which could operate on exposed
SRs as well. If we offer this sooner rather than later, then we
needn't worry about users writing crazy workarounds later (i.e.
popping docsets into a filter query) just to perform deletes
when using Lucene NRT.

I'd rather not limit people's using NRT/getReader because they rely
on per doc deletes, which as it turns out is really trivial to
support (when LUCENE-1516 was written, I wasn't fully aware of
how deletes work, now that I know it's all synced on IW, I don't
think it's a big deal).

I guess we should map out what the worst case scenarios are
(i.e. what is the worst thing the user can do with the mutable
SR access?). Then we can specifically limit it?

I'm not sure how the worst case scenario will change when we
refactor the IW APIs? Meaning the user will still need to be
advanced (probably more advanced after offering pluggable IW
APIs). They could still break things (unless we limit what's
breakable), and we'd still basically be offering SR access?

> Allow updating of IndexWriter SegmentReaders
> --------------------------------------------
>
> Key: LUCENE-2071
> URL: https://issues.apache.org/jira/browse/LUCENE-2071
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Index
> Affects Versions: 2.9.1
> Reporter: Jason Rutherglen
> Priority: Minor
> Fix For: 3.1
>
> Attachments: LUCENE-2071.patch
>
>
> This discussion kind of started in LUCENE-2047. Basically, we'll allow users to perform delete document, and norms updates on SegmentReaders that are handled by IndexWriter.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe [at] lucene
For additional commands, e-mail: java-dev-help [at] lucene

Lucene java-dev RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.