Mailing List Archive by Gossamer Threads http://www.gossamer-threads.com/lists/lucene/java-user/ en-us (c) Gossamer Threads Inc. All rights reserved. 25 Nov 2009 03:07:42 -0800 120 75 23 http://www.gossamer-threads.com/lists/lucene/java-user/ http://www.gossamer-threads.com/images/lists/rss_logo.jpg I do not understand your request completely, maybe you tell us some more requirements of your implementation. The example you have given is invalid, 25 Nov 2009 02:05:56 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/90046 Hi Dhivya, you can iterate all terms in the index using a TermEnum, that can be retrieved using IndexReader.terms(Term startTerm). If you are intere 25 Nov 2009 01:54:43 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/90045 Hi all,   Am using lucene 2.3.2 as a search engine in my e-paper site. So that i want the user to search the news. I achieved that objective but now a 24 Nov 2009 23:05:43 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/90040 Hi, I find it is very hard to implement a GivenCharFilter(extends TokenFilter)using incrementToken. My requirment is like this: I want to analyze 24 Nov 2009 20:15:30 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/90032 On Mon, Nov 23, 2009 at 12:14 PM, Uwe Schindler <uwe@thetaphi.de> wrote: > If you just want to autocomplete the current term the user enters, > initi 24 Nov 2009 17:56:30 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/90030 For what it's worth, AOL uses a Solr cluster to handle searches for @aol users. Each user has his own index. Otis -- Sematext is hiring -- http://se 24 Nov 2009 15:20:08 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/90029 No, createOutput is designed to always create a new file. This fits with Lucene because Lucene is "write once" (never writes to the same file more th 24 Nov 2009 12:51:05 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/90020 OK, I'll add that to the javadocs; thanks. But the fact that you weren't closing the old readers was probably also tying up lots of disk space... Mi 24 Nov 2009 12:39:41 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/90019 Hi, this is good information. as I read your post I realized that I am supposed to commit after an optimize, which is something I do not currently do. 24 Nov 2009 12:31:27 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/90018 On Tue, Nov 24, 2009 at 9:08 AM, vsevel <v.sevel@lombardodier.com> wrote: > Hi, just to make sure I understand correctly... After an optimize, withou 24 Nov 2009 08:59:43 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89985 I am also having a hard time understanding the NewSpansUnordered isPayloadAvilable() method. For my test case where 2 tokens are at the same position 24 Nov 2009 07:55:46 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89958 Hello, For certain span queries I construct problematically by piecing together my own SpanTermQueries I would like to enforce that Payload data is n 24 Nov 2009 06:56:19 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89957 yes that indeed works for me. thanks, On Mon, Nov 23, 2009 at 5:50 PM, Paul Elschot <paul.elschot@xs4all.nl>wrote: > Op maandag 23 november 2009 2 24 Nov 2009 06:17:09 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89934 Hi, just to make sure I understand correctly... After an optimize, without any reader, my index takes 30Gb on the disk. Are you saying that if I can e 24 Nov 2009 06:08:31 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89933 On Nov 24, 2009, at 7:09 AM, m.harig wrote: > > What should i do now , could you make me clear ?? > How are you constructing the SpellChecker? 24 Nov 2009 05:13:03 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89932 Thanks a lot! of course performance :) I used 2.41 and now with 2.9.1 it works:) Michael McCandless pisze: > Are you sure you even need to do this ( 24 Nov 2009 04:49:56 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89931 What should i do now , could you make me clear ?? Grant Ingersoll-6 wrote: > > > On Nov 24, 2009, at 1:16 AM, m.harig wrote: > >> >> String[] su 24 Nov 2009 04:09:34 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89904 On Nov 24, 2009, at 1:16 AM, m.harig wrote: > > String[] suggestions = spellChecker.suggestSimilar("hoem", 3,indexReader, > "contents", true); > > 24 Nov 2009 04:01:13 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89903 I don't really like that name, for the same reason ("create" and "new" imply that an entirely new reader is being created, which is far more costly th 24 Nov 2009 02:22:21 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89902 Erick, Thanks for all your help so far. I'll try and see if upgrading to 2.9.1 won't cause us too much changes and if it's stable enough. If upgradin 24 Nov 2009 02:17:33 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89877 How about newReader()? ----- Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: uwe@thetaphi.de > -----Original Messa 24 Nov 2009 02:02:58 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89876 On Tue, Nov 24, 2009 at 1:44 AM, vsevel <v.sevel@lombardodier.com> wrote: > > 1) correct: I am using IndexWriter.getReader(). I guess I was assuming t 24 Nov 2009 01:59:55 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89875 Are you sure you even need to do this (manage separate RAMDir)? Ie what's driving this (performance)? IndexWriter already has its own RAM buffer for 24 Nov 2009 01:45:02 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89874 Hi Rafal, If what I understand about your implementation is correct, you could try a parallelmultisearcher http://lucene.apache.org/java/2_9_1/api/co 23 Nov 2009 23:16:15 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89866 fulin tang wrote: > We are going to add full-text search for our mailbox service . > > The problem is we have more than 1 PB mails there , and obvious 23 Nov 2009 22:56:50 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89865 Hi all! i've just started my adventure with Lucene i've got one question regarding indexing. Does Lucene have got built-in mechanism to store indexe 23 Nov 2009 22:51:23 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89864 1) correct: I am using IndexWriter.getReader(). I guess I was assuming that was a privately owned object and I had no business dealing with its lifecy 23 Nov 2009 22:44:32 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89863 String[] suggestions = spellChecker.suggestSimilar("hoem", 3,indexReader, "contents", true); this is how am retrieving my did you mean words Grant 23 Nov 2009 22:16:50 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89855 String[] suggestions = spellChecker.suggestSimilar("hoem", 3,indexReader, "contents", true); this is how am retrieving my did you words Grant Inge 23 Nov 2009 22:16:19 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89854 A sharded architecture (i.e. smaller indexes) used by Google for example and implemented by open source in the Katta project may be best for scaling t 23 Nov 2009 21:41:06 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89853 hello all is there any way to update the spell index directory ? please any1 help me out of this. -- View this message in context: http://old.na 23 Nov 2009 21:34:59 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89852 Hi, I have not worked on a petascale (yet!) - mostly on the scale of tens of terabyes - but I do think Lucene would be very helpful for such usecase. 23 Nov 2009 19:59:03 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89851 We are going to add full-text search for our mailbox service . The problem is we have more than 1 PB mails there , and obviously we don't want to add 23 Nov 2009 18:35:57 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89850 This was a really silly idea I had <G>. If your time is being spent in the scoring in the first place, keeping the Filter out of the query and checkin 23 Nov 2009 16:14:03 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89839 Op maandag 23 november 2009 20:07:58 schreef Christopher Tignor: > Also, I noticed that with the above edit to NearSpansOrdered I am getting > erroneo 23 Nov 2009 14:50:34 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89838 When you say "getting a reader of the writer" do you mean writer.getReader()? Ie the new near real-time API in 2.9? For that API (an in general when 23 Nov 2009 14:17:23 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89823 Hi, I am using lucene 2.9.1 to index a continuous flow of events. My server keeps an index writer open at all time and write events as groups of a few 23 Nov 2009 12:20:31 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89822 Thanks guys, I get the point, it is best to reindex(hope it isnt very expensive). And yes, it's true that the suppliers dont change often. I -- View 23 Nov 2009 12:14:02 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89807 Also, I noticed that with the above edit to NearSpansOrdered I am getting erroneous results fo normal ordered searches using searches like: "_n" foll 23 Nov 2009 11:07:58 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89806 IndexWriter will try the merge again, the next time it checks merges (eg after flushing a new segment, but not after adding a new document). You'll o 23 Nov 2009 09:45:10 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89797 Thank you, Mike, for explanation. So I understand that all the data is kept even if any of these merging threads fail. Will Lucene keep attempting m 23 Nov 2009 09:40:34 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89796 Thanks so much for this. Using an un-ordered query, the -1 slop indeed returns the correct results, matching tokens at the same position. I tried th 23 Nov 2009 09:26:54 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89795 If you just want to autocomplete the current term the user enters, initialize a TermEnum with the current entered term fragment. If you then iterate t 23 Nov 2009 09:14:08 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89794 See: http://issues.apache.org/jira/browse/LUCENE-1427 <http://issues.apache.org/jira/browse/LUCENE-1427>Short form: this is fixed, but not until 2.9. 23 Nov 2009 09:12:29 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89793 For auto complete, you could try the following: 1. Run a prefix query. [Could be a fuzzy query] 2. Index using something like ngrams. term : sample i 23 Nov 2009 08:59:39 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89792 Your trying -1 with ordered right? Try it with non ordered. Christopher Tignor wrote: > A slop of -1 doesn't work either. I get no results returned. 23 Nov 2009 08:59:28 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89791 Op maandag 23 november 2009 17:27:56 schreef Christopher Tignor: > A slop of -1 doesn't work either. I get no results returned. I think the problem 23 Nov 2009 08:56:51 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89790 A slop of -1 doesn't work either. I get no results returned. this would be a *really* helpful feature for me if someone might suggest an implementat 23 Nov 2009 08:27:56 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89789 I've taken TermsFilter from contrib which does exactly that and indeed the speed was reduced to half, which starts to be reasonable for my needs. I'v 23 Nov 2009 08:01:36 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89783 Tested it out. It doesn't work. A slop of zero indicates no words between the provided terms. E.g. my query of "plan" "_n" returns entries like "co 23 Nov 2009 06:20:47 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89782 Oh my goodness yes. No wonder nothing I suggested made any difference <G>. Ignore everything I've written.... OK, here's something to try, and it goe 23 Nov 2009 05:54:35 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89778 Erick, Maybe I didn't make myself clear enough. I'm talking about high level filters used when searching. I construct a very big BooleanQuery and ad 23 Nov 2009 05:12:54 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89777 Now I'm really confused, which usually means I'm making some assumptions that aren't true. So here they are... 1> You're talking about Filters that c 23 Nov 2009 04:55:39 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89775 There are some tricks you can apply, but they amount to keeping your own lists and manipulating them manually. As Ian says, Lucene isn't a database, a 23 Nov 2009 04:44:48 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89776 Hi Joel, I encounter the same problem. Could you please elaborate a bit on this? Many thanks, Liat 2009/11/2 Joel Halbert <joel@su3analytics.com> 23 Nov 2009 03:55:41 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89761 Sir,   I actually meant auto suggest as such available for google suggest similar to autocomplete. Where, users need not type the entire text and inst 23 Nov 2009 02:58:35 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89760 By autosuggest, would you mean similar documents? In that case you could try the lucene 'morelikethis' class. -- Anshum Gupta Naukri Labs! http://ai- 23 Nov 2009 02:35:14 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89759 > That was a good solution to my problem and i found my fields for the document. Good. > Acutally i was trying it to find out how to implement autos 23 Nov 2009 02:32:19 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89758 After commenting out the collector logic, the time is still more or less the same. Anyway, since without the filter collecting the documents is very f 23 Nov 2009 02:18:37 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89744 That was a good solution to my problem and i found my fields for the document. Acutally i was trying it to find out how to implement autosuggest with 23 Nov 2009 02:12:34 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89743 Use this tool to examine the index: http://www.getopt.org/luke/ I would also suggest getting hold of a Lucene book such as Lucene In Action (http://w 23 Nov 2009 02:11:53 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89742 Lucene is not a database. You'll need to flatten the data and yes, that does mean duplication. -- Ian. On Mon, Nov 23, 2009 at 9:05 AM, sameerpat 23 Nov 2009 02:09:43 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89741 Lucene will index and store the fields that you tell it to when a document is written to the index. In lucene 2.4 doc.getFields() returns a List of a 23 Nov 2009 02:08:10 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89740 Sir,   Am using lucene 2.3.2. I would like to know what are the fields that are been indexed?   Ex:   doc.get("path");   this statement returns the pa 23 Nov 2009 01:42:51 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89739 Hi, I have a requirement where I have a list of Suppliers(documents for lucene index) and a list of Products(documents again). Each Product has a s 23 Nov 2009 01:06:06 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89738 Hi, I have a requirement where I have a list of Suppliers(documents for lucene index) and a list of Products(documents again). Each Product has a s 23 Nov 2009 01:05:43 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89737 You are right Paul, 0 would not work, probably something less than zero, as Paul suggested. Give it a try and tell us if it worked ; ) On Sun, Nov 22 22 Nov 2009 23:11:53 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89732 How are you invoking the spell checker? On Nov 19, 2009, at 1:22 AM, m.harig wrote: > > hello all > > i've a doubt in spell checker , w 22 Nov 2009 17:07:43 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89723 To call clear, you can always downcast to AttributeImpl. But you need to know, that it may clear also other attributes (like if it is a Token). So set 22 Nov 2009 11:30:07 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89687 Ok I see you fixed it at the same time I sent the email :). I think I get it ... so far. So far I had to cache just TermAttribute. I think it'll get 22 Nov 2009 11:25:49 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89686 I assume termAtt is the input's TermAttribute, right? Therefore it has no copyTo ... What I've done so far is create a TermAttribute like you propose 22 Nov 2009 11:23:50 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89685 Sorry small error: Class Initializer: private final AttributeSource lastState = cloneAttributes(); private final TermAttribute lastTermAtt = lastStat 22 Nov 2009 11:22:16 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89684 The cast to TermAttributeImpl may not work if the factory creates a Token... So declare termBuf as TermAttribute (without impl). To clear, you can al 22 Nov 2009 11:21:07 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89683 Did you mean something like: TermAttributeImpl termBuf = (TermAttributeImpl) input.getAttributeFactory().createAttributeInstance(TermAttribute.class) 22 Nov 2009 11:14:46 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89682 Another idea, what you can also do is, create an AttributeSource instance in your TokenStream one time using the AttributeSource.cloneAttributes() cal 22 Nov 2009 11:14:21 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89681 I said, you *could* if it would be exposed. But the State is a holder class without functionality. Because the internals are impl dependent, maybe we 22 Nov 2009 11:03:03 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89680 Yes I can clone the term itself by instantiating a TermAttributeImpl, which is better than storing the String, because the latter always allocates cha 22 Nov 2009 10:52:39 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89679 Hmmm, could you show us what you do in your collector? Because one of the gotchas about a collector is loading the documents in the inner loop. Quick 22 Nov 2009 10:36:38 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89678 Hi Jake, Many thanks for your quick reply. I shall check these out. Thanks! Peter > Date: Sun, 22 Nov 2009 09:20:24 -0800 > Subject: Re: 22 Nov 2009 09:45:30 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89664 Op zondag 22 november 2009 17:23:53 schreef Eran Sevi: > Thanks for the tips. > > I'm still using version 2.4 so I can't use MultiTermQueryWrapperFil 22 Nov 2009 09:37:57 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89663 Peter, You want to do a facet query. This kind of functionality is not in Lucene-core (sadly), but both Solr (the fully featured search applicati 22 Nov 2009 09:20:24 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89662 Hello Lucene Experts, I wonder if someone might be able to shed some insight on this interesting scoring question: The problem: Build a search que 22 Nov 2009 08:42:09 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89661 I think it shouldn't take X5 times longer since the number of results is only about X2 times larger (and much smaller than the number of terms in the 22 Nov 2009 08:41:26 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89660 Thanks for the tips. I'm still using version 2.4 so I can't use MultiTermQueryWrapperFilter but I'll definitely try to re-group the the terms that ar 22 Nov 2009 08:23:53 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89658 Maybe this helps you, but read the docs, it will work only with single-value-fields: http://lucene.apache.org/java/2_9_1/api/core/org/apache/lucene/se 22 Nov 2009 08:10:45 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89627 Hmmm, I'm not very clear here. Are you saying that you effectively form 10-50K filters and OR them all together? That would be consistent with the 50K 22 Nov 2009 07:57:02 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89659 Try a MultiTermQueryWrapperFilter instead of the QueryFilter. I'd expect a modest gain in performance. In case it is possible to form a few groups of 22 Nov 2009 07:51:15 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89626 Hi, I have a need to filter my queries using a rather large subset of terms (can be 10K or even 50K). All these terms are sure to exist in the index 22 Nov 2009 06:48:39 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89625 > Because that'd mean I'll check for abbreviations for every token. Which is > a > big performance loss. That way, I can just check abbr if I encounte 22 Nov 2009 06:42:50 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89624 Because that'd mean I'll check for abbreviations for every token. Which is a big performance loss. That way, I can just check abbr if I encountered a 22 Nov 2009 06:37:03 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89623 If you just want to lookup if "Mr" is an abbreviation, why not look it up when you handle that token and set a boolean variable in the TS (lastTokenWa 22 Nov 2009 06:34:56 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89622 What I've done is: State state = in.captureState(); ... // Upon new call to incrementToken(). State tmp = in.captureState(); in.restoreState(state); 22 Nov 2009 06:27:45 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89621 Perhaps I misunderstand something. The current use case I'm trying to solve is - I have an abbreviations TokenFilter which reads a token and stores it 22 Nov 2009 05:57:43 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89604 Use captureState and save the state somewhere. You can restore the state with restoreState to the TokenStream. CachingTokenFilter does this. So the n 22 Nov 2009 05:33:11 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89603 ok so from what I understand, I should stop working w/ Token, and move to working w/ the Attributes. addAttribute indeed does not work. Even though i 22 Nov 2009 05:28:56 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89602 > But I do use addAttribute(Token.class), so I don't understand why you say > it's not possible. And I completely don't understand why the new API > a 22 Nov 2009 04:58:16 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89601 Op zondag 22 november 2009 04:47:50 schreef Adriano Crestani: > Hi, > > I didn't test, but you might want to try SpanNearQuery and set slop to zero. 22 Nov 2009 04:50:27 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89600 But I do use addAttribute(Token.class), so I don't understand why you say it's not possible. And I completely don't understand why the new API allows 22 Nov 2009 04:44:00 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89599 > > I want to add Token.class, and then work w/ Token. Not TermAttribute, > PosIncrAttribute, OffsetAttribute, PayloadAttribute and TypeAttribute > ( 22 Nov 2009 04:36:35 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89598 > I started to migrate my Analyzers, Tokenizer, TokenStreams and > TokenFilters > to the new API. Since the entire set of classes handled Token before 22 Nov 2009 04:35:58 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89597