Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Zope: Dev

Re: SVN: zope.index/trunk/ - Port okascore.c optimization used in okapiiindex from Zope2 catalog

 

 

Zope dev RSS feed   Index | Next | Previous | View Threaded


tseaver at palladion

Jun 9, 2009, 5:07 PM

Post #1 of 2 (317 views)
Permalink
Re: SVN: zope.index/trunk/ - Port okascore.c optimization used in okapiiindex from Zope2 catalog

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Chris McDonough wrote:
> Log message for revision 100775:
> - Port okascore.c optimization used in okapiiindex from Zope2 catalog
> implementation. This module is compiled conditionally, based on
> whether your environment has a working C compiler.
>
> - Don't use ``len(self._docweight)`` in okapiindex _search_wids method
> (obtaining the length of a BTree is very expensive at scale).
> Instead use self.documentCount(). Also a Zope2 port.

Crap! this set of performance fixes was added *six years ago* to the
Zope2 version from which zope.index was forked!

Hasn't anybody been using this package?


Tres.
- --
===================================================================
Tres Seaver +1 540-429-0999 tseaver[at]palladion.com
Palladion Software "Excellence by Design" http://palladion.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFKLvkv+gerLs4ltQ4RAqC8AKCjJefCXo3eXBiW5cH1uC+70Qz/lQCcD6t2
o0aJ+MhKZBWUT/CKhXKD9+Y=
=gHGc
-----END PGP SIGNATURE-----

_______________________________________________
Zope-Dev maillist - Zope-Dev[at]zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
** No cross posts or HTML encoding! **
(Related lists -
http://mail.zope.org/mailman/listinfo/zope-announce
http://mail.zope.org/mailman/listinfo/zope )


ct at gocept

Jun 9, 2009, 10:41 PM

Post #2 of 2 (278 views)
Permalink
Re: SVN: zope.index/trunk/ - Port okascore.c optimization used in okapiiindex from Zope2 catalog [In reply to]

On Tue, 2009-06-09 at 20:07 -0400, Tres Seaver wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Chris McDonough wrote:
> > Log message for revision 100775:
> > - Port okascore.c optimization used in okapiiindex from Zope2 catalog
> > implementation. This module is compiled conditionally, based on
> > whether your environment has a working C compiler.
> >
> > - Don't use ``len(self._docweight)`` in okapiindex _search_wids method
> > (obtaining the length of a BTree is very expensive at scale).
> > Instead use self.documentCount(). Also a Zope2 port.
>
> Crap! this set of performance fixes was added *six years ago* to the
> Zope2 version from which zope.index was forked!
>
> Hasn't anybody been using this package?

We're using this package. The text index I can only remember in a
not-so-critical piece where performance currently is not an issue. Also,
following checkins even today wouldn't have me remember that this code
is shared.

Christian

--
Christian Theune · ct[at]gocept.com
gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany
http://gocept.com · tel +49 345 1229889 7 · fax +49 345 1229889 1
Zope and Plone consulting and development
Attachments: signature.asc (0.19 KB)

Zope dev RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact lists@gossamer-threads.com
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.