Mailing List Archive by Gossamer Threads http://www.gossamer-threads.com/lists/lucene/java-user/ en-us (c) Gossamer Threads Inc. All rights reserved. 06 Oct 2008 17:50:06 -0800 120 75 23 http://www.gossamer-threads.com/lists/lucene/java-user/ http://www.gossamer-threads.com/images/lists/rss_logo.jpg It appears if a search field value entered contains a ':' causes some issues since if I have a field named a.b.c and the user enters a value of foo t 06 Oct 2008 12:54:12 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/66100 I am stumped and have not seen any other reference to this problem. I am getting the following exception on everything I try to index. Does anyone kno 06 Oct 2008 11:23:58 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/66092 Hi, I am using lucene 2.3.2 and I encounter the following exception when I try to insert a object into the index. Caused by: java.lang.ClassCastExce 03 Oct 2008 12:40:10 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/66041 Hello all, My indexing is growing by 1 million records per day and the memory consumption of the searcher object is quite high. There are different 03 Oct 2008 02:31:03 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/66016 Hi Everyone, I have an index which I am opening at one time only. I keep adding the documents to it until I reach a limit of 500. After this, I close 03 Oct 2008 01:26:31 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/66014 What should I use if I want to try to extract events (dates/times) out of an HTML page? I looked at Tika since it's a parsing project. Am I on the rig 02 Oct 2008 16:18:22 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/66005 Hi! I'm currently developing a mediabase for 20-100 customers. A Customer can upload a file, folder via ftp and a file grabber searches the file syst 02 Oct 2008 14:23:55 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/66003 Hi everybody, I'm trying to use the Lucene index on a web application, on which there are many concurrent users. How can I share the Lucene index to m 02 Oct 2008 11:49:06 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/66001 Hi, Maybe I have missunderstood the general concept of how search results should be scored in regards to the fieldNorm, but the way i see it it cause 02 Oct 2008 04:39:46 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65994 Begin forwarded message: > From: Noirin Shirley <noirin@apache.org> > Date: October 2, 2008 4:22:06 AM EDT > To: pmcs@apache.org > Subject: CFP open 02 Oct 2008 02:02:51 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65990 OK, after googling around for a while, I found this: http://wooga.drbacchus.com/lucene-and-documentation (alas, I agree) and then eventually I rea 01 Oct 2008 12:13:43 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65969 Dear Lucene and Solr users - I'm presenting Lucene/Solr Case Studies at ApacheCon in a month: <http://us.apachecon.com/c/acus2008/sessions/41 > I 01 Oct 2008 05:37:08 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65953 Hi, I asked this question already on "lucene-general" list but also got advised to ask here too. I'm working on a project that has big database in t 01 Oct 2008 00:43:57 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65942 Hi all, Here is a new newbee question. I'm adding to a lucene index, documents containing a field lrt created as follows: doc.add( new Field( "lrt", 30 Sep 2008 06:24:47 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65933 Has anyone tried to implement a triplet store with lucene? Best, -C.B. --------------------------------------------------------------------- To unsu 29 Sep 2008 05:51:43 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65895 Is there a specific reason that you write your text in this way? I mean, indentions instead of line breaks? It makes it very hard to read, if you ask 29 Sep 2008 03:52:02 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65878 It looks like either "null" was passed to Document.addField(...), or, a Field instance with "null" as its name was added to the document? Mike Nob 27 Sep 2008 01:46:35 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65862 Any idea on how this exception can happen? ---------- Forwarded message ---------- From: Dinesh Gupta <dinesh.gupta01@hotmail.com> Date: Thu, Sep 25 27 Sep 2008 00:46:34 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65861 I am baffled by the results of the following queries. Can it be something to do with the boosting factor? All of these queries are performed in the sa 26 Sep 2008 12:55:43 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65850 Cross-posting... Just wanted to let everyone know that there will be a number of Lucene/ Solr/Mahout/Tika related talks, training sessions, and Bird 26 Sep 2008 11:53:59 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65848 NOTE: This is a cross posted announcement to all Lucene sub-projects, please confine any replies to general@lucene. ------------- The Travel Assist 26 Sep 2008 10:25:03 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65846 Hi all, The index has Millions of entries. I need to display the index content in a JTable with columns (terms, field, freq) and the user can choose 26 Sep 2008 09:07:42 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65835 Hello you all, is it somehow possible to get all document ids found by a search. Not only 50 or 100... If it is possible and someone knows it, pl 26 Sep 2008 07:31:37 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65819 Hello all, I need to do warmup the searcher object from my JSP pages. Currently i am having a static object, which i am frequently checking whether 26 Sep 2008 07:13:05 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65816 We have an application in which index will be updated frequently. During development time, found that index files gets corrupted, i.e. more than 26 Sep 2008 04:13:03 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65803 We have an application in which index will be updated frequently. During development time, found that index files gets corrupted, i.e. more than one 26 Sep 2008 03:49:26 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65801 Hi Guys, Does anybody know if it is possible results to be sorted using the ParallelReader? Best Regards, Ivan ----------------------------------- 26 Sep 2008 00:38:30 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65793 First of all, thanks to all the people who helped me in getting the lucene replication setup working and right now its live in our production :-) Eve 25 Sep 2008 22:23:04 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65792 According to https://issues.apache.org/jira/browse/LUCENE-1282?focusedCommentId=12596949#action_12596949 (Sun hotspot compiler bug in 1.6.0_04/05 affe 25 Sep 2008 17:09:53 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65791 Hi, I was wondering when lucene queries two or more terms, does that mean the time it takes will be twice as long? For example if I search +lucene +ap 25 Sep 2008 10:39:05 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65784 Hi, I just created the second release candidate for Lucene 2.4, here: http://people.apache.org/~mikemccand/staging-area/lucene2.4rc2 These are t 25 Sep 2008 08:11:00 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65782 Hi, I have the following scenario using Lucene 2.1 1. Open reader on index to perform some searches. 2. Use reader to check if index is optimized. 2 25 Sep 2008 02:08:48 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65772 hi all i tried to reuse the IndexSearcher among all of the threads that are doing searches as described in (http://wiki.apache.org/lucene-java/Luce 25 Sep 2008 01:56:40 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65771 Hi all, Could you please help me understand hos that works. If I boost documents at index time based on some kind of criteria and if I am to sort on 24 Sep 2008 02:04:44 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65748 Hi, I am using snappuller to sync my slave with master, i am not using rsync daemon, i am doing Rsync using remote shell. When i am serving requests 23 Sep 2008 20:00:02 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65743 Hello, If I had a file with the following content: ... object.method(); ... I would like to be able to query for object method object.method My gues 22 Sep 2008 14:40:35 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65677 Hello Is it possible to exclude numbers using StandardAnalyzer just like SimpleAnalyzer? --------------------------------------------------------- 22 Sep 2008 04:16:19 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65641 Hi, In my webapp I'm trying to use the lucene api to build queries instead of the QueryParser but I haven't found out where to specify the Analyzer. 22 Sep 2008 01:46:19 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65637 Hi all. I have a question about Korean tokenisation. Currently there is a rule in StandardTokenizerImpl.jflex which looks like this: ALPHANUM = 21 Sep 2008 21:49:34 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65631 Hi! I've a lucene document structured like: Field: Text name: George Bush Sex: Male Occupation: President of USA Now I can have two types of queries 21 Sep 2008 12:27:04 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65623 Hi list, I have some days with a problem and I hope anybody can help me. I have developed an extension module to search documents in an eXist collect 20 Sep 2008 14:10:21 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65608 Hi, I need to specify in my query ranges with product price. I wonder if the only solution is padding values with zeros. For example, if I'm looking 19 Sep 2008 02:51:17 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65548 Hi, all! How to implement Front-end match use lucene? Say, two Documents in index: Document<stored/uncompressed,indexed<field:abc>> Document<stored/u 19 Sep 2008 02:05:22 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65542 Hi all, How can I implemented this scenario in lucene? suppose every document has three fields: docid, doctext and simdocid. docid is the id of the 19 Sep 2008 01:00:20 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65532 After 5 month work we are happy to announce the first developer preview release of katta. This release contains all functionality to serve a large, 18 Sep 2008 12:20:45 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65511 Hi, I just created the first release candidate for 2.4, here: http://people.apache.org/~mikemccand/staging-area/lucene2.4rc1 Please download the 18 Sep 2008 11:29:15 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65506 Hi All, Scenario: I have 100 documents in an index and if these documents fall into 10 mutualy exclusive set; And within that set one of them is the 18 Sep 2008 08:27:57 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65496 Hi, We have been running Lucene 2.3 for last few months with our application and all the sudden we have hit the following exception, java.la 17 Sep 2008 13:24:29 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65446 Hi All I'm having a problem with our lucene index and wondering if anyone else has encountered anything similar or has any idea of what I might look 17 Sep 2008 09:45:04 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65431 Hi , I am facing below problem. Please help me in this. I have integrated CJK Analyzer for Japanese characters. I am able to save japanese double b 17 Sep 2008 07:41:34 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65421 Hello all, I am have indexed more than 4 million documents. My query fetches 300,000 hits. If i perform sorting on any field, then tomcat reports ou 17 Sep 2008 05:46:03 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65413 Hi all, I am wondering if Lucene implements the query optimisation that consists of ordering the posting lists based on the term frequency before i 17 Sep 2008 05:19:01 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65412 Hello All, Anyone has tried this? My UI has a requirement to show total number of results and then show results in pages. How do I do that with T 17 Sep 2008 04:37:06 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65411 Hi All, I'm running Ubuntu Linux 8.04, which has the sun jre installed in the system area (/usr/lib/jvm/java-6-sun-1.6.0.06/jre/lib/). I've manually 16 Sep 2008 23:39:27 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65397 what is the behaviour of IndexReader.current() if i modify the index manually? Will it returns false? One more question The index is on Linux if 16 Sep 2008 17:40:57 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65394 Hi, We're thinking of using Lucene to integrate search in a backup service application. The background is that we have a bunch of users using a b 16 Sep 2008 07:55:09 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65378 Hi! I'm writing application that should be using lucene for searching threw ~2000000 documents. Search criterias i'm collecting using BooleanQuery a 16 Sep 2008 06:20:00 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65372 Hi there, I am using WhiteSpaceAnalyser to index documents. I have used this because i need to split tokens based on space only. Also Tokensized=true 16 Sep 2008 06:05:17 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65364 Hi all, Well this is my first post on this list. Nice to meet you all. Im currently putting in place a system which index data with Apache Lucene 16 Sep 2008 02:28:09 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65355 Hi all, We stuck a 60 GB OCZ "Core Series" SSD in a Dell T5400 (dual quadcore, 16GB RAM, SATA II 7200 RPM disk) and did some comparisons between ru 16 Sep 2008 02:06:41 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65351 Hello, Lets say I have two documents, both containing field F. document 0 has the string "a b" as F document 1 has the string "b a" as F I am tryin 15 Sep 2008 22:33:48 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65346 Hello, Could it harm if I make a searcher.search(query, Integer.MAX_VALUE) ? I just need to make a query to get the number of hits in this case, bu 15 Sep 2008 19:42:41 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65335 Hello, What kind of query is best to warm up a searcher? How many searches should I do? Are we supposed to search for things we know do exist, or is 15 Sep 2008 17:50:35 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65334 Hello, Here is what I am trying to do: dir = FSDirectory.getDirectory("/test"); writer = new IndexWriter(dir, analyzer, true, new In 15 Sep 2008 12:05:19 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65304 Hello, I would like to get advantage of isDeleted. If I delete a document from index, and not commit, and index searcher is not reinstantiated, how c 15 Sep 2008 11:42:49 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65300 Hello, What is the new favorable way of searching a query? I understand Hits will be depreciated. So how do we do it the new way? With hit collector 15 Sep 2008 10:54:07 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65297 Hello, What is the difference between flush in <2.4 and commit? Also I have been looking over docs, and they mention commit(long) but there is no co 15 Sep 2008 10:49:48 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65296 Hello, I see that IndexWriter.flush() is depreciated in 2.4. What do we use? Also I used to make a: try { nodeWriter = new Inde 15 Sep 2008 10:32:07 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65295 Hello, I have been looking at instantiated index in the trunk. Does this come with a searcher? Are the adds reflected directly to the index? Or is i 15 Sep 2008 09:45:01 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65288 Hi All, I am trying to utilize Filter to see if I can get a bit more performance out of my application that searches over 100million document lucene 15 Sep 2008 08:17:35 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65279 Hello, To patch for lucene-1314 what must I do? I think I have to cd into one of the directories, then patch -pX < ../../patchfile, but I could not 15 Sep 2008 04:38:42 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65265 Hi; I am trying to write an application that's working on Blackberry or other java enabled phones. This application talk with the server and Ask s 15 Sep 2008 00:55:25 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65260 Hi, I am seeing odd behavior with SpanNearQuery. The problem is that with multiple fields, all fields beyond the first one 'car' are not seen by th 14 Sep 2008 10:36:38 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65251 Hi the community, In a Tomcat application (a keyword-based search engine), I use Lucene 2.3.2 to index 60 million documents, but each document is sma 14 Sep 2008 06:58:24 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65246 Hi. I'm new to Lucene and I would like to get a few answers (they can be lame) I want to index large amount of emails using Lucene (maybe S 12 Sep 2008 04:57:49 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65164 Hi, I have a large index and I want to remove the norms from a field. Is there a way to do this without reindexing everything ? Thank you, Bogdan - 12 Sep 2008 03:25:56 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65154 Hi gents, is it possible to use TermsFilter with the 'MUST' occurence rule, instead of the 'SHOULD'? In the code: def tf = new TermsFilter() for( s 12 Sep 2008 03:18:17 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65153 Up to now I have only needed to search a single index, but now I will have many index shards to search across. My existing search mantained cached f 11 Sep 2008 19:57:40 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65141 Hello, Lets say we have different document types, and one type of document only contains field A. How can I make a query so that I get all the docum 11 Sep 2008 15:31:02 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65134 I have implemented a MapReduce job to merge a bunch of Lucene 2.3.2 indices together, but the reducers randomly fail with the following unchecked exce 11 Sep 2008 14:18:19 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65132 Hi, In our application, I want users to be able to search for the updates they make almost immediately. Hence, whenever they update, I spawn a thre 11 Sep 2008 13:43:16 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65130 Hi, I have an algorithm that would benefit from using a lot of fields, more precisely about 5000 fields. It does sound like a lot to me and I'd like 11 Sep 2008 11:04:18 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65124 Hi there. I am trying to implement sorting in a large index (3 million documents). My sort field is simple integer with values between 1 and 100. Wi 11 Sep 2008 09:31:41 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65114 Hi All, I vaguely remember discussions on lucene remote-ability of HitCollectors based search(). As far as I remember, it is not possible if I use H 11 Sep 2008 08:13:32 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65110 Hi, I have to index terms with different boosts, meaning that if the word A appears in two documents one document will be ranked higher. I've tried 11 Sep 2008 07:28:34 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65098 hi folks, I'm new to Lucene and I'm looking for a way to search a substring that starts at a fixed position. It isn't a classical substring search bec 11 Sep 2008 04:34:35 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65082 Hi All, In my project I use Hits from Searcher.search() for my query results. If I am to move to Lucene 3's ways, I will have to use TopDocs I presu 11 Sep 2008 02:46:45 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65074 Hi, I am currently using the demo class IndexFiles to index some corpus. I have replaced the Standard by a GermanAnalyzer. Here, indexing works fine. 11 Sep 2008 01:03:46 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65068 Hi, I'm was sure this discussion has come up before, but after looking around alot I haven't found a suitable answer. I have a need to index num 10 Sep 2008 21:54:14 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65063 This usually happens on J2EE environment, if you use RAMDirectory. Before Lucene-1195.(svn r659602, May23,2008), if you close() RAMDirectory, the reso 10 Sep 2008 11:32:56 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65039 > And if you have configured an analyzer that includes a query-time > filter, it should be invoked, regardless of whether a phrase query is > construc 10 Sep 2008 10:20:19 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65028 > > But this does not return the hits i want. > > Have you tried submitting the query without quotes? (That's where the > PhraseQuery likely comes f 10 Sep 2008 10:20:18 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65025 Hi@all Is it possible to do a search with multiple wildcards in one query, for instance "%MANAGE%" AND "CORE%"? Is there a code example available? 10 Sep 2008 06:06:09 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/65001 Quick summary of situation (using 2.3.2, StandardAnalyzer): I've taken a field that was being created as a "default" for a document, e.g. a giant s 09 Sep 2008 20:57:10 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/64985 Hi, We have a customer using lucene on an NFS directory, which contains ~10Gb of .nfsXXXX files. These files are the means by which NFS implement 09 Sep 2008 19:06:34 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/64980 > Looks to me like MultiPhraseQuery is getting in the way. Shingles > that begin at the same word are given the same position by > ShingleFilter, and 09 Sep 2008 14:20:14 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/64970 -- original post was on solr's user list. -- -- i've reposted here as it's centered on the ShingleFilter which comes from lucene -- *ShortVersion* 09 Sep 2008 10:20:16 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/64961 Hi all, I am currently using a (slightly modified) version of the IndexFiles demo class of Lucene to index a corpus. As I understand it, the index lis 09 Sep 2008 08:54:18 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/64960 in the past, I made really good experiences with the svn versions of lucene - I never had problems, and everything feeled stable. Currently, I get un 09 Sep 2008 06:23:07 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/64946 Hi, I think I have a very easy question to answer (I am a Lucene beginner and like it very much!): I have built lucene documents and indexes from a d 09 Sep 2008 04:10:26 -0800 http://www.gossamer-threads.com/lists/lucene/java-user/64942