Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: kinosearch: discuss

Extending SegWriter (was Re: Wildcards)



kinosearch discuss RSS feed   Index | Next | Previous | View Threaded

marvin at rectangular

Jan 30, 2008, 10:36 AM

Post #1 of 1 (860 views)
Extending SegWriter (was Re: Wildcards)

On Jan 29, 2008, at 8:06 PM, Nathan Kurz wrote:

>> R-trees are a more efficient data structure for geospatial
>> searching. However, there's no RTreeWriter writing R-tree data to
>> each segment in KS by default. I'd like to write one and make it
>> easy to integrate via InvIndexer/SegWriter.
> This is a beautiful concrete example. If KinoSearch was flexible
> enough to
> accommodate this smoothly, it seems likely it would be able to
> accommodate a very wide range of other uses as well.

At the indexing stage, I'm thinking something along these lines:

my $r_tree_writer = KSx::RTree::RTreeWriter->new;
my $seg_writer = KinoSearch::Index::SegWriter->new;

my $invindexer = KinoSearch::InvIndexer->new(
invindex => MySchema->open('/path/to/invindex'),
seg_writer => $seg_writer,

RTreeWriter would need to implement add_doc(), add_segment(), and
finish(), plus possibly init().

Not that much to it! A lot of the work has already been done. We'll
have to make a bunch of classes public, e.g. SegInfo, InStream/
OutStream, but those are all reasonably mature by now.

Marvin Humphrey
Rectangular Research

KinoSearch mailing list
KinoSearch [at] rectangular

kinosearch discuss RSS feed   Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.