Mailing List Archive by Gossamer Threads http://www.gossamer-threads.com/lists/lucene/java-user/ en-us (c) Gossamer Threads Inc. All rights reserved. 23 Nov 2009 16:58:09 -0800 120 75 23 http://www.gossamer-threads.com/lists/lucene/java-user/ http://www.gossamer-threads.com/images/lists/rss_logo.jpg Hi, I am using lucene 2.9.1 to index a continuous flow of events. My server keeps an index writer open at all time and write events as groups of a few 23 Nov 2009 12:20:31 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89822 Sir,   I actually meant auto suggest as such available for google suggest similar to autocomplete. Where, users need not type the entire text and inst 23 Nov 2009 02:58:35 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89760 Sir,   Am using lucene 2.3.2. I would like to know what are the fields that are been indexed?   Ex:   doc.get("path");   this statement returns the pa 23 Nov 2009 01:42:51 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89739 Hi, I have a requirement where I have a list of Suppliers(documents for lucene index) and a list of Products(documents again). Each Product has a s 23 Nov 2009 01:05:43 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89737 Hello Lucene Experts, I wonder if someone might be able to shed some insight on this interesting scoring question: The problem: Build a search que 22 Nov 2009 08:42:09 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89661 Hi, I have a need to filter my queries using a rather large subset of terms (can be 10K or even 50K). All these terms are sure to exist in the index 22 Nov 2009 06:48:39 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89625 Hi I started to migrate my Analyzers, Tokenizer, TokenStreams and TokenFilters to the new API. Since the entire set of classes handled Token before, 22 Nov 2009 03:12:02 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89585 I use Lucene's IndexOutput to dump index contents to a file, I use createOutput method in FSDirectory to create the file in the directory with the giv 21 Nov 2009 07:36:43 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89546 Hi, probably a newbie question (both newbie with Lucene and I don't do something with Java very often): I want to use org.apache.lucene.analysis.de 21 Nov 2009 03:06:02 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89519 I was experimenting how Lucene handles 2-phase commit. Then I noticed I am not catching all Exceptions from Lucene. And I think this is because Lucen 20 Nov 2009 16:03:24 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89487 I'm interested in getting the payload information from the matching span, however it's unclear from the javadocs why NearSpansUnordered is different t 20 Nov 2009 15:49:42 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89486 Hi, I am evaluating several search algoritms, and I iterate on each. In each interation I delete the index directory, index the docs and I run the ev 20 Nov 2009 11:18:08 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89464 Hi all, I'm happy to announce a new release of Luke - the Lucene Index Toolbox. Please note that Luke development has moved to Google Code, and the 20 Nov 2009 04:25:36 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89409 hi, I have a problem with scoring a document in lucene. I know there are some factors such as docNum,boost,idf,docFreq,lengthNorm and so on. And I 20 Nov 2009 02:46:16 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89405 Hi ! Can someone tell me what is replacing ChainedFilter in Lucene 2.9? I used to do it like this - h = searcher.search(q, cluCF, cluSort); Where 19 Nov 2009 20:27:53 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89402 Hello, I would like to search for all documents that contain both "plan" and "_v" (my part of speech token for verb) at the same position. I have tok 19 Nov 2009 14:28:09 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89377 What is the best way to iterate across all the documents in a search results? Previously I was using the deprecated Hits object but changed the implen 19 Nov 2009 07:36:46 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89355 Hi, is this a good idea/possible to continue writing events to an index while optimizing it, in 2 differents threads, in the same process, using the 19 Nov 2009 02:42:03 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89342 hello all i've a doubt in spell checker , when i search for a keyword hoem am getting the spell results as in the following order (in whic 18 Nov 2009 22:22:03 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89337 Hi, I am using lucene 2-9-1. I am reading in free text documents which I index using lucene and the StandardAnalyzer at the moment. The StandardAna 18 Nov 2009 21:58:11 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89335 Hi, Please use java-user list for user questions. Are you sure the file got fully indexed in the first place? Use Luke to check. Also, see: Index 18 Nov 2009 21:50:41 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89334 Hi all. If I want to find the lowest term in a field, I can do something like this: public Date computeEarliestDate(IndexReader reader) throws I 18 Nov 2009 19:48:18 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89328 Hello, I have indexed words in my documents with part of speech tags at the same location as these words using a custom Tokenizer as described, very 18 Nov 2009 14:20:08 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89318 Hello, Firstly, thanks for all the good answers and support form this mailing list. Would it be possible and if so, what would be the best way to re 18 Nov 2009 13:39:32 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89307 Hello Lucene users, On behalf of the Lucene dev community (a growing community far larger than just the committers) I would like to announce the 17 Nov 2009 14:25:03 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89223 Hello, Hoping someone might clear up a question for me: When Tokenizing we provide the start and end character offsets for each token locating it wi 17 Nov 2009 10:45:26 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89208 Hi all, I made a list of 4 simple, singe term queries and do 4 searches via Lucene and find that if the term is used for search in the first time, Lu 17 Nov 2009 09:39:14 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89186 Hello, Hoping someone might clear up a question for me: When Tokenizing we provide the start and end character offsets for each token locating it wi 17 Nov 2009 07:37:10 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89164 Hello all, I am having millions of records in the database and in that 75% of the records required to be sorted. Does 2.9 provides facility to do cu 17 Nov 2009 02:23:44 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89142 Hello all, Sorry if this is offtopic or already discussed/documented somewhere. Regarding lucene 2.9.1 javadoc: In Searcher the method "TopDocs sea 17 Nov 2009 01:32:58 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89138 Hi, all I found a suggestion in 'Lucene in Action' : use 'java -server' to run faster. As I tested, it's 2 times faster than normal 'java' which uses 16 Nov 2009 17:54:15 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89121 I have a custom query object whose scorer uses the 'AllTermDocs' to get all non-deleted documents. AllTermDocs returns the docId relative to the segme 16 Nov 2009 10:39:25 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/89034 Hi, In our application, we will allow the user to create a primary key defined in the document. We are using lucene 2.9. In this case, when we index 16 Nov 2009 09:15:40 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88998 I am looking at adding some sorting functionality to my application and read that Sort fields should not be tokenized - can anyone explain why? I have 16 Nov 2009 07:36:53 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88975 Hi: I did some performance analysis for different ways of doing numeric ranging with lucene. Thought I'd share: http://invertedindex.blogspot.com 15 Nov 2009 22:02:40 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88922 Hi, all I'm facing a large index, on a x86 win platform which may not have big enough jvm heap space to hold the entire index. So, I think it's possib 15 Nov 2009 19:12:23 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88914 From Here to There, You Can Find it Anywhere: > Building Local/Geo-Search > with Apache Lucene and Solr Join us for a free webinar hosted by TechTar 15 Nov 2009 14:42:43 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88912 I bought the original Lucene in Action, read it, set up integration with my system--a small Java daemon that monitors db for changes & updates the ind 15 Nov 2009 13:58:38 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88901 Hi all, In 'Lucene in Action', I read "Limit how many fields you directly load into the FieldCache" to reduce RAM usage during searching. But I can't 15 Nov 2009 06:02:23 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88873 Hi, i'm having some problems with the size of the fragmentes when i'm doing the highlight. I pass on the constructor of the SimpleSpanFragmenter a siz 14 Nov 2009 17:21:49 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88848 SynonymTokenFilter, if I understand correctly, maps a given token to a set of tokens representing its synonyms. If used in the filter chain of a query 14 Nov 2009 13:35:42 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88830 Is there any limit on how many IndexWriter can I keep open at same time? What does it depends on (RAM?) Can I keep 100 or 200 IndexWriters open in say 14 Nov 2009 08:35:08 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88822 I'm writing a TokenFilter and am confused about why class Token has both an *endOffset* and a *termLength* field. It would appear that the following 13 Nov 2009 14:50:17 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88763 Hi, I am trying to move from a system where I counted the frequency of terms by hand in a highlighter to determine if a result was useful to me. In a 13 Nov 2009 14:09:30 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88746 Hi, I am indexing log4j/logback/JUL logging events. my documents includes regular fields (eg: logger, message, date, ...) and custom fields that appl 13 Nov 2009 08:44:20 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88727 Hi. I am developing an application and I would like to add searching capabilities. I have a database with items. Each item has a number of "features" 13 Nov 2009 06:42:49 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88722 We are using lucene for one our projects here and has been working very well for last 2 years. The new requirement is to use it for autocomplete. Here 13 Nov 2009 05:50:38 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88714 Hi all, I got OutOfMemoryError at org.apache.lucene.search.Searcher.search(Searcher.java:183) My index is 43G bytes. Is that too big for Lucene ? Luk 12 Nov 2009 23:22:53 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88679 Hello everyone, I'm a little bit confused about the docBase parameter of Collector.setNextReader. Imagine the following: - Create new Index - In 12 Nov 2009 13:25:06 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88652 I have a document with the title "Here, there be dragons" and a body. When I search for Here, there be dragons (no quotes) with a title boost of 2 12 Nov 2009 12:00:22 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88643 Is there a setting to fix this? [junit] Exception in thread "main" java.lang.OutOfMemoryError: Java heap space [junit] at java.util.Arrays.cop 12 Nov 2009 11:38:29 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88640 I'm trying to use a precompiled Lucene index from within a WAR archive, and was having difficulty, but found a possible solution: http://mail-archives 12 Nov 2009 09:06:01 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88623 Hello List. I'm having a problem when I add a Sort object to my searcher: docs = searcher.search(parser.parse(search), null, 50, sort); Every ti 12 Nov 2009 07:57:37 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88612 Dear all, I am pretty sure it's trivial and I apologize for raising this issue. I wish to access the index in the order driven by: Term+"Field na 12 Nov 2009 06:45:56 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88611 Hi, I am trying to figure out a way that I can query a Lucene index for a phrase but have some fuzziness (edit distance and/or wildcard) applied t 11 Nov 2009 14:48:45 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88567 I am pondering a way to allow closing of an index searcher and releasing the pointer to it so that it automatically cleans up by itself when all t 11 Nov 2009 14:12:10 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88559 Hi I index documents with numeric fields using the new Numeric package. I execute two types of queries: range queries (for example, [.1 TO 20}) and e 11 Nov 2009 05:54:36 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88515 Hi Guys, Given a class with two static variables, is the following safe? ie If I call "close" while something else is using the objects, do the o 10 Nov 2009 21:13:33 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88478 Apologies if this info is already somewhere, but google cant find it (: I am assuming the following code is completely thread safe: // Called fro 10 Nov 2009 16:23:54 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88469 I noticed that this question has been asked but I could not find good answer so I am posting again. Is there a good example of sorting and pagination 10 Nov 2009 14:35:47 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88449 Hi There Our app spends alot of time waiting for Lucene to finish writing to the index. I'd like to minimize this. If you have a moment to spare, pl 10 Nov 2009 08:43:30 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88386 Hi, I want to change the default scoring formula of lucene and one of the changes I want to perform is on the idf term. What I want to do is to inclu 10 Nov 2009 04:32:12 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88367 hello all, This is my situation , i've multiple indexes , for example , index1 , index2 , index3 ... i've to update the indexes every night . If 10 Nov 2009 01:05:45 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88344 Hi, guys, I have such a problem: I have lots of files. In these files, two of them are related to each other and should be deemed as a whole 10 Nov 2009 00:44:16 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88339 Hi, everybody, I am new to Lucene and have a question about how to update my index. The following is my situation: 1) I create indexes for each 09 Nov 2009 22:39:15 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88335 I know this has been asked before, but I couldn't find the thread. The jar file produced from a build of 2.9.0 is 'lucene-core-2.9.jar'. For 2.9.1, it 09 Nov 2009 15:38:20 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88314 As some of you may recall I've been working on getting the SEN Japanese morphological analyzer working with 2.9. (and also with Solr 1.4, but that's 09 Nov 2009 11:55:01 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88293 Hi, i've got a problem concerning encoding of norms. I want to use int values (0-255) instead of float interpreted bytes. In my own Similarity-Class 09 Nov 2009 08:04:09 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88269 i want to classify sentences stored as strings to a bunch of keywords related to a certain category. so i will have 10 strings which will be a sente 09 Nov 2009 07:33:41 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88265 Hi All, For those who are interested, the official Lucid Solr trainings are now available in Europe. The first training - "Introduction to Solr" is 09 Nov 2009 06:47:53 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88267 The requirement is to perform a Quick search on a DB table that has more than a million real estate property records where the primary search criteria 09 Nov 2009 02:51:53 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88244 Hi all, What's the best way to index digital strings ? currently I'm using doc.add(new Field("id", docid, Field.Store.YES, Field.Index.NOT_ANALYZE 08 Nov 2009 22:48:41 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88230 Hi all, I want to query part of a digital string: say indexed token is "123456789" I want to query 56789 to match this token The "Query Parser Syntax" 08 Nov 2009 20:44:10 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88225 Hi all. We updated to Lucene 2.9, and now we find that after closing our text index, it is not possible to rename the directory in which it resides ( 08 Nov 2009 19:29:45 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88222 Hi, I have a field and a wighted synonym map. I have indexed the synonyms with the weight as payload. my code snippet from my filter *public Token ne 08 Nov 2009 05:23:28 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88185 Hi guys: Running into a strange problem: I am indexing into a field a numeric string: int n = Math.abs(rand.nextInt(1000000)); Field 08 Nov 2009 00:36:07 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88170 Hi, How do I go about indexing domain names? I currently index the domain, but it only works if I put the exact full domain in. For example: site:ww 07 Nov 2009 22:20:34 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88168 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Release 2.9.1 of Apache Lucene java is now available. This release fixes bugs from 2.9.0, including on 07 Nov 2009 07:19:02 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88145 No sir but its getting downloaded in the prescribed format. I have attached a screenshot. --- On Fri, 6/11/09, Anshum <anshumg@gmail.com> wrote: Fr 06 Nov 2009 20:55:42 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88126 Hi, I am trying to modify the indexing chain of Lucene. To start, I have extracted and modified the default indexing chain. I have just removed the 06 Nov 2009 09:29:20 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88084 If I use an IndexWriter and set the RAMBufferSizeMB to 16(default) or lower the memory is freed as expected and the memory of the process will level o 06 Nov 2009 08:33:13 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88080 I'm trying to use a two phase commit involving a Lucene index and an external file derived from the index. Here are the steps: 1. prepare commit on L 06 Nov 2009 07:59:24 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88068 Hi All, One of things that we want to do in our application is to assign the score to a doc which is something like this score = (# terms matched to 06 Nov 2009 03:37:30 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88065 Hi all,   Am using Java Lucene through web.   When i execute through Netbeans, its working well. My problem is:   It is displaying the list of links t 06 Nov 2009 01:10:28 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88062 Hi all. I am trying to clean up some deprecated calls which are showing up on upgrading to 2.9.0 (from 2.3.2...), and I have just come across Directo 05 Nov 2009 21:39:17 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88052 Hi All, I hope someone can offer some advice. I want to extend lucene to search in a particular way(if it cant already): I want to index docs, each w 05 Nov 2009 16:31:23 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88043 Hi all, (Apologies for the cross-post) It's been a while since the last time we met up, so we're organising another open source search social evenin 05 Nov 2009 13:57:44 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/88020 Hi, I want to calculate a tag cload for search results. I have seen, that it is possible to extract the top 20 words out of the lucene index. Is ther 05 Nov 2009 07:21:08 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/87989 Hello all, Due to some constraint in memory, I want to load less terms in memory. In case of Lucene 2.4.1, IndexDivisor is not working when we do reo 05 Nov 2009 02:46:36 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/87982 Hi, I have a scenario as described below user U1 - books purchased ,b1, b5, ... so on user U2 - books purchased ,b2, b7, ... so on ... ... ... Un 04 Nov 2009 22:18:35 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/87975 Hi, say I have: - Indexreader[] readers = {reader1, reader2, reader3} //containing all different docs - I know the internal docids of documents in 04 Nov 2009 06:23:21 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/87925 Team, For those Lucene fanatics not in Oakland this week for ApacheCon US, don't miss the FREE live video streaming, starting today: http://stream 04 Nov 2009 05:25:25 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/87917 I am rewriting some BooleanQueries and the end result contains some empty queries. The initial query is of the form: Field1:foo* Field2:foo* Field3:f 04 Nov 2009 00:28:18 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/87904 This is an issue found by Findbugs. In the file FSDirectory the method void touchFile() should return the boolean result of the setLastModified method 03 Nov 2009 17:05:19 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/87892 Given two parallel indexes one with slowly changing fields and one with fields which are updated regularly. Is it possible to periodically merge thes 03 Nov 2009 08:24:39 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/87869 Hi, Could anyone comment on how should I handle one-to-many relationship of domain objects in lucene? I have been searching the archive but was unabl 03 Nov 2009 02:44:37 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/87855 Hello I am trying to develop an API for a search application that is using Lucene 2.4.1 The search application is maintained by RAA (swedish goverme 03 Nov 2009 01:23:41 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/87844 Hi, the following junit test fails on 3 out of the 6 searches: @Test public void indexXML() throws Exception { Analyzer analyzer = ne 02 Nov 2009 23:40:44 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/87837 For backwards compatabiity I have to change queries for the track field to the recording field. I did this by overriding QueryParser.newQuery() as 02 Nov 2009 14:48:53 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/87822 Yes - please share your test programs and I can investigate (ApacheCon this week, so I'm not sure when). And its best to keep communications on the l 02 Nov 2009 05:04:38 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/87790