Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Lucene: Java-User

Sorting on tokenized fields

 

 

Lucene java-user RSS feed   Index | Next | Previous | View Threaded


florian at archive

Jul 20, 2004, 5:13 PM

Post #1 of 3 (2449 views)
Permalink
Sorting on tokenized fields

I see in the Javadoc that it is only possible to sort on fields that
are not tokenized, I have two questions about that:

1) What happens if the field is tokenized, is sorting done anyway,
using the first term only?

2) Is there a way to do some sorting anyway, by concatenating all the
tokens into one string?

--

Florian


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe [at] jakarta
For additional commands, e-mail: lucene-user-help [at] jakarta


amordo at infosciences

Jul 21, 2004, 6:18 AM

Post #2 of 3 (2239 views)
Permalink
RE: Sorting on tokenized fields [In reply to]

You can create a new field which contains the full untokened string and use
it as a sort field.


-----Original Message-----
From: Florian Sauvin [mailto:florian [at] archive]
Sent: Tuesday, July 20, 2004 20:13 PM
To: Lucene Users List
Subject: Sorting on tokenized fields


I see in the Javadoc that it is only possible to sort on fields that
are not tokenized, I have two questions about that:

1) What happens if the field is tokenized, is sorting done anyway,
using the first term only?

2) Is there a way to do some sorting anyway, by concatenating all the
tokens into one string?

--

Florian


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe [at] jakarta
For additional commands, e-mail: lucene-user-help [at] jakarta



---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe [at] jakarta
For additional commands, e-mail: lucene-user-help [at] jakarta


michael_prichard at mac

Jan 8, 2008, 1:41 PM

Post #3 of 3 (2236 views)
Permalink
Re: Sorting on tokenized fields [In reply to]

yes, no worries.

i just check in advance what fields are available and build the Sort
object accordingly. Eventually BCC would be there...but not
necessary so at first.

Anyway, got it to work! Thanks for your help.

All the best,
Michael

On Jan 8, 2008, at 4:37 PM, Doron Cohen wrote:

> Hi Michael, I think you mean the exception thrown when you
> search and sort with a field that was not yet indexed:
>
> RuntimeException: field "BBC" does not appear to be indexed
>
> I think the current behavior is correct, otherwise an application
> might (by a bug) attempt to sort by a wrong field, that not only
> does not exist yet but will never exist. To prevent hidden bugs
> cases like this it is important to throw an exception in this case.
> Do you agree?
>
> On Jan 8, 2008 11:21 PM, Michael Prichard
> <michael_prichard [at] mac> wrote:
>
>> Meaning that it says "field is not indexed". Where is
>> sortMissingLastAttribute?
>>
>> thanks.
>>
>> On Jan 8, 2008, at 4:13 PM, Ryan McKinley wrote:
>>
>>> what do you mean by "fail"? -- there is the sortMissingLast
>>> attribute
>>>
>>>
>>> Michael Prichard wrote:
>>>> ok... i should read the manual more often.
>>>> i went ahead and just added untokenized, unstored sort fields....
>>>> question, if I put a field in to sort of but say I have not
>>>> indexed any as of yet...will the Sort fail? For example, say I
>>>> have a BCC field and nothing has been indexed with that yet....I
>>>> run a sort on BCC.....I think it fails now...anyway around that?
>>>> On Jan 8, 2008, at 1:22 PM, Michael Prichard wrote:
>>>>> Is it possible to sort on a tokenized field? For example, I
>>>>> break email address into pieces, i.e.
>>>>>
>>>>> michael.prichard [at] email
>>>>>
>>>>> becomes
>>>>>
>>>>> michael.prichard [at] email
>>>>> michael.prichard
>>>>> michael
>>>>> prichard
>>>>> email.com
>>>>> email
>>>>>
>>>>>
>>>>> so when sorting on this field I get some strange results. Do I
>>>>> need to create another field just for sorting? Or are there
>>>>> other ways to do it?
>>>>>
>>>>> Thanks!
>>>>> Michael
>>>>>
>>>>> ------------------------------------------------------------------
>>>>> --
>>>>> -
>>>>> To unsubscribe, e-mail: java-user-unsubscribe [at] lucene
>>>>> For additional commands, e-mail: java-user-help [at] lucene
>>>>>
>>>> -------------------------------------------------------------------
>>>> --
>>>> To unsubscribe, e-mail: java-user-unsubscribe [at] lucene
>>>> For additional commands, e-mail: java-user-help [at] lucene
>>>
>>>
>>> --------------------------------------------------------------------
>>> -
>>> To unsubscribe, e-mail: java-user-unsubscribe [at] lucene
>>> For additional commands, e-mail: java-user-help [at] lucene
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe [at] lucene
>> For additional commands, e-mail: java-user-help [at] lucene
>>
>>


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe [at] lucene
For additional commands, e-mail: java-user-help [at] lucene

Lucene java-user RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.