Mailing List Archive: DBMail: users

dbmail performance test

Index | Next | Previous | View Threaded

a.babic at ecircle

May 27, 2009, 3:01 PM

Post #1 of 9 (747 views)
Permalink

dbmail performance test

Hi,

I am using dbmail for several years. Recently I have made performance
test of dbmail and cyrus. I have 350 users in dbmail with total 4
million mails.
The biggest mailbox has a bit more than 150000 mails.

Then I created the same users for cyrus and with imapsync copied all
mails from dbmail to cyrus. Yes, it took few days to finish.

This is an test environment so I had exclusive access to it.

Dbmail version 2.2.11 compiled from source
Cyrus version 2.2.13-14+b3 (debian package)

Both imaps use mysql for authentication.

Database dbmail took 48G while cyrus mail storage had 30G for the same
amount of mails.

I run simple test with expect scripts and measuring time difference
between establishing and closing connection to each imap.

What I have got from tests is that search is much faster on dbmail and
fetch is much faster on cyrus.

For example on the mailbox which had 39661 unread mails search on cyrus
imap took 20 seconds. The same operation on identical mailbox on
dbmail took 12.7 seconds.

On the other side, fetching headers from all mails in inbox with "fetch
1:* body[header]" took on dbmail 20 seconds while the same operation
on cyrus took 3 seconds.

I want to point that originaly I had mysql parameter tmp_table_size set
to 30M and then search on dbmail took ages on 3000 big maibox.
After I increased this parameter to 500M search was flying and tests
mentioned above are done when tmp_table_size was set to 500M.

I am using roundcube webmail as front end for dbmail imap server and
after login it takes ages to open huge mailbox. I would appreciate if
you know and tell me if there is any "trick" to increase speed of fetch
on dbmail.

Regards,

Andreja
_______________________________________________
DBmail mailing list
DBmail[at]dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

gordan at bobich

May 27, 2009, 3:50 PM

Post #2 of 9 (713 views)
Permalink

Re: dbmail performance test [In reply to]

On 27/05/2009 23:01, Andreja Babic wrote:

> I am using roundcube webmail as front end for dbmail imap server and
> after login it takes ages to open huge mailbox. I would appreciate if
> you know and tell me if there is any "trick" to increase speed of fetch
> on dbmail.

Have you enabled Roundcube's caching?

Gordan
_______________________________________________
DBmail mailing list
DBmail[at]dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

josh at worldhosting

May 27, 2009, 4:06 PM

Post #3 of 9 (712 views)
Permalink

Re: dbmail performance test [In reply to]

> I am using roundcube webmail as front end for dbmail imap server and
> after login it takes ages to open huge mailbox. I would appreciate if
> you know and tell me if there is any "trick" to increase speed of fetch
> on dbmail.

One thing I'd suggest if you're using a webmail is to use imapproxy.
That way you wont get continual reconnects to the imap server. This
speeds up webmail considerably (regardless of the imap server)

Something else to consider is subsequent searches. While dbmail has to
access different data for search as for fetch, Cyrus has to load the
whole mailbox into memory to search. Subsequent accesses to the mailbox
for cyrus is probably using the memory cache. So try doing the search a
few times and see if there is a cache in there giving you skewed
results.

The next thing to consider is availability on your server. What happens
if some smoke comes out of your motherboard? To properly compare mail
systems (my opinion) you need to compare total performance, especially
including downtime. For a highly-available server you really need to
have at least two servers. The dbmail database is very easy to replicate
between two servers in master-master configuration, using ucarp or
heartbeat to arbitrate the active mysql server (you can't load balance
mysql for imap protocol reasons, however you can load balance the dbmail
so that e.g. your spam/virus scanning can run on both servers). The
level of complexity added for replicating the cyrus mailboxes decreases
the performance considerably, especially if you have two servers
accessing the mailboxes concurrently over nfs, gfs, ocfs2 etc... if at
all possible (does cyrus use maildir or mbox format?)

Another thing to consider is the amount of flexibility the database
gives you with mail. It's a simple query to purge old, unread email from
mailboxes. The dbmail-users table shows how much email is in everyone's
folders (So much faster than du)

I moved our servers from a 3-server postfix / courier-imap / Maildir /
drbd / NFS / amavisd to a 3-server postfix / dbmail / MySQL /
clamsmtpd / dspam installation. The newer configuration is a lot faster
than the old, especially in peak periods. And the added flexibility I
now have is a huge bonus. I use a separate server again to act as a
MySQL slave which I can start and stop to perform full snapshot backups
of the database without any load or interruption on the main mail
servers. We are a small isp and have two installations of approx. 4500
accounts, 700,000 emails in 50Gb of emails (mysql is using 70Gb of disk
space) with a turnover of about 20,000 emails/day - not massive but
relatively busy sites.

All the above said, you should tune your database as best as possible,
and remove some of the unnecessary indexes as proposed by Michael
Monnerie (although this just improves inserts not selects). There were
some conversations a while back on mysql parameters, do a search through
the archives.

Regards,
Josh.

_______________________________________________
DBmail mailing list
DBmail[at]dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

vulture at netvulture

May 27, 2009, 6:46 PM

Post #4 of 9 (709 views)
Permalink

Re: dbmail performance test [In reply to]

It would be very nice if you were to compare the new 2.3.x from git vs.
2.2.x. I suspect that the size of the database will be much less than
your 2.2 install and would like to see what performance difference there
really is. If you were to run this test, please copy all the messages
into a fresh database vs. converting a copy of your 2.2 database. That
way all messages are stored in the single-instance-storage and all
header caching is done in a single table.

Thanks,
-Jon

Andreja Babic wrote:
> Hi,
>
> I am using dbmail for several years. Recently I have made performance
> test of dbmail and cyrus. I have 350 users in dbmail with total 4
> million mails.
> The biggest mailbox has a bit more than 150000 mails.
>
> Then I created the same users for cyrus and with imapsync copied all
> mails from dbmail to cyrus. Yes, it took few days to finish.
>
> This is an test environment so I had exclusive access to it.
>
> Dbmail version 2.2.11 compiled from source
> Cyrus version 2.2.13-14+b3 (debian package)
>
> Both imaps use mysql for authentication.
>
> Database dbmail took 48G while cyrus mail storage had 30G for the same
> amount of mails.
>
> I run simple test with expect scripts and measuring time difference
> between establishing and closing connection to each imap.
>
> What I have got from tests is that search is much faster on dbmail and
> fetch is much faster on cyrus.
>
> For example on the mailbox which had 39661 unread mails search on cyrus
> imap took 20 seconds. The same operation on identical mailbox on
> dbmail took 12.7 seconds.
>
> On the other side, fetching headers from all mails in inbox with "fetch
> 1:* body[header]" took on dbmail 20 seconds while the same operation
> on cyrus took 3 seconds.
>
> I want to point that originaly I had mysql parameter tmp_table_size set
> to 30M and then search on dbmail took ages on 3000 big maibox.
> After I increased this parameter to 500M search was flying and tests
> mentioned above are done when tmp_table_size was set to 500M.
>
> I am using roundcube webmail as front end for dbmail imap server and
> after login it takes ages to open huge mailbox. I would appreciate if
> you know and tell me if there is any "trick" to increase speed of fetch
> on dbmail.
>
>
> Regards,
>
> Andreja
> _______________________________________________
> DBmail mailing list
> DBmail[at]dbmail.org
> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
>
>

--
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.

_______________________________________________
DBmail mailing list
DBmail[at]dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

a.babic at ecircle

May 28, 2009, 12:36 AM

Post #5 of 9 (708 views)
Permalink

Re: dbmail performance test [In reply to]

Hi Jon,

Interesting idea. I will do so and let you know the results.

Andreja

-----Urspr�ngliche Nachricht-----
Von: dbmail-bounces[at]dbmail.org [mailto:dbmail-bounces[at]dbmail.org] Im Auftrag von Jonathan Feally
Gesendet: Donnerstag, 28. Mai 2009 03:46
An: DBMail mailinglist
Betreff: Re: [Dbmail] dbmail performance test

It would be very nice if you were to compare the new 2.3.x from git vs.
2.2.x. I suspect that the size of the database will be much less than
your 2.2 install and would like to see what performance difference there
really is. If you were to run this test, please copy all the messages
into a fresh database vs. converting a copy of your 2.2 database. That
way all messages are stored in the single-instance-storage and all
header caching is done in a single table.

Thanks,
-Jon

Andreja Babic wrote:
> Hi,
>
> I am using dbmail for several years. Recently I have made performance
> test of dbmail and cyrus. I have 350 users in dbmail with total 4
> million mails.
> The biggest mailbox has a bit more than 150000 mails.
>
> Then I created the same users for cyrus and with imapsync copied all
> mails from dbmail to cyrus. Yes, it took few days to finish.
>
> This is an test environment so I had exclusive access to it.
>
> Dbmail version 2.2.11 compiled from source
> Cyrus version 2.2.13-14+b3 (debian package)
>
> Both imaps use mysql for authentication.
>
> Database dbmail took 48G while cyrus mail storage had 30G for the same
> amount of mails.
>
> I run simple test with expect scripts and measuring time difference
> between establishing and closing connection to each imap.
>
> What I have got from tests is that search is much faster on dbmail and
> fetch is much faster on cyrus.
>
> For example on the mailbox which had 39661 unread mails search on cyrus
> imap took 20 seconds. The same operation on identical mailbox on
> dbmail took 12.7 seconds.
>
> On the other side, fetching headers from all mails in inbox with "fetch
> 1:* body[header]" took on dbmail 20 seconds while the same operation
> on cyrus took 3 seconds.
>
> I want to point that originaly I had mysql parameter tmp_table_size set
> to 30M and then search on dbmail took ages on 3000 big maibox.
> After I increased this parameter to 500M search was flying and tests
> mentioned above are done when tmp_table_size was set to 500M.
>
> I am using roundcube webmail as front end for dbmail imap server and
> after login it takes ages to open huge mailbox. I would appreciate if
> you know and tell me if there is any "trick" to increase speed of fetch
> on dbmail.
>
>
> Regards,
>
> Andreja
> _______________________________________________
> DBmail mailing list
> DBmail[at]dbmail.org
> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
>
>

--
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.

_______________________________________________
DBmail mailing list
DBmail[at]dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
_______________________________________________
DBmail mailing list
DBmail[at]dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

michael.monnerie at is

May 28, 2009, 1:42 AM

Post #6 of 9 (708 views)
Permalink

Re: dbmail performance test [In reply to]

On Donnerstag 28 Mai 2009 Andreja Babic wrote:
> Database dbmail took 48G while cyrus mail storage had 30G for the
> same amount of mails.

Boah, a very huge difference! I'd love to know what dbmail 2.3 would be
in size.

> What I have got from tests is that search is much faster on dbmail
> and fetch is much faster on cyrus.
>
> For example on the mailbox which had 39661 unread mails search on
> cyrus imap took 20 seconds. The same operation on identical mailbox
> on dbmail took 12.7 seconds.

Please also compare results of the searches. Dbmail has a bug somewhere
(don't remember exactly, lookup archives, maybe of -dev), which will not
necessarily find all messages.
Please also do different kinds of searches (subject, From:, any header,
any content, etc.).

> On the other side, fetching headers from all mails in inbox with
> "fetch 1:* body[header]" took on dbmail 20 seconds while the same
> operation on cyrus took 3 seconds.

Please perform such accesses always 5 times in a row, and remember each
time. Caches will change performance on both products, would be
interesting to see how much.

Are you also able to do this:
*) simulate a single user signing in, read list of all mailboxes (should
be 20 or so with subfolders), then for every mailbox get list of
messages, read some messages. Close. Make other tests with other users,
and deliver about 100 messages into that users mailboxes. Reconnect as
that user again, get list of new mails. read some of them. close
*) then rerun above test with 20 users in parallel.
*) then again with 50 users in parallel.

Maybe we can see which product scales better. Although we have no idea
which hardware you test on.

mfg zmi
--
// Michael Monnerie, Ing.BSc ----- http://it-management.at
// Tel: 0660 / 415 65 31 .network.your.ideas.
// PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import"
// Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4
// Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4

Attachments:

signature.asc (0.19 KB)

qingran.xia at gmail

May 28, 2009, 3:17 AM

Post #7 of 9 (714 views)
Permalink

Re: dbmail performance test [In reply to]

On Thu, May 28, 2009 at 6:01 AM, Andreja Babic <a.babic[at]ecircle.com> wrote:
>
> Hi,
>
> I am using dbmail for several years. Recently I have made performance
> test of dbmail and cyrus. I have 350 users in dbmail with total 4
> million mails.

Good job!
BTW, is anyone going to do the same performance test between dbmail and dovecot?

--
$B2F[at]6A3(B
Xia Qingran
qingran.xia[at]gmail.com

Bette Davis - "Brought up to respect the conventions, love had to end
in marriage. I'm afraid it did." -
http://www.brainyquote.com/quotes/authors/b/bette_davis.html
_______________________________________________
DBmail mailing list
DBmail[at]dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

a.babic at ecircle

Jun 3, 2009, 2:31 PM

Post #8 of 9 (683 views)
Permalink

Re: dbmail performance test [In reply to]

Hi guys,

I am trying to install dbmail-2.3.5 but without success by now.

What I tried is to install is dbmail-2.3.5 + libzdb-2.5. As there is no libzdb debian package for debian-5.0 I have installed libzdb from source. But, after all I got an error while doing "make all":

----error----
_db.c -fPIC -DPIC -o .libs/libdbmail_la-dm_db.o
dm_db.c: In function 'db_connect':
dm_db.c:200: warning: comparison between signed and unsigned
dm_db.c: In function 'db_exec':
dm_db.c:315: error: void value not ignored as it ought to be
dm_db.c: In function 'db_stmt_set_str':
dm_db.c:398: error: void value not ignored as it ought to be
dm_db.c: In function 'db_stmt_set_int':
dm_db.c:403: error: void value not ignored as it ought to be
dm_db.c: In function 'db_stmt_set_u64':
dm_db.c:408: error: void value not ignored as it ought to be
dm_db.c: In function 'db_stmt_set_blob':
dm_db.c:413: error: void value not ignored as it ought to be
dm_db.c: In function 'db_stmt_exec':
dm_db.c:417: error: void value not ignored as it ought to be
dm_db.c: In function 'db_begin_transaction':
dm_db.c:477: error: invalid use of void expression
dm_db.c: In function 'db_commit_transaction':
dm_db.c:485: error: invalid use of void expression
dm_db.c: In function 'db_rollback_transaction':
dm_db.c:496: error: invalid use of void expression
dm_db.c: In function 'user_idnr_is_delivery_user_idnr':
dm_db.c:795: warning: dereferencing type-punned pointer will break strict-aliasing rules
dm_db.c:798: warning: dereferencing type-punned pointer will break strict-aliasing rules
make[3]: *** [libdbmail_la-dm_db.lo] Error 1
make[3]: Leaving directory `/usr/local/src/dbmail-2.3.5/src'
make[2]: *** [all-recursive] Error 1
make[2]: Leaving directory `/usr/local/src/dbmail-2.3.5/src'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/usr/local/src/dbmail-2.3.5'
make: *** [all] Error 2
----error----

then I found this thread : http://www.nabble.com/problem-compiling-2.3.5-with-libzdb-2.4-(trunk)-td21558842.html where Paul says that libzdb-2.2 should be used.

On official site of libzdb there is no chance to download required version: http://www.tildeslash.com/libzdb/download.html and I found this option:

# svn list http://libzdb.googlecode.com/svn/tags/
release-2-2/
release-2-2-1/
release-2-2-2/
release-2-2-3/
release-2-3/
release-2-4/
release-2-5/

So, at the end I downloaded required version of libzdb from here svn checkout http://libzdb.googlecode.com/svn/tags/release-2-2 libzdb-2-2

but there is no configure file. I am stuck here. Any help would be appreciated.

Thanks in advance,

Andreja

-----Urspr�ngliche Nachricht-----
Von: dbmail-bounces[at]dbmail.org [mailto:dbmail-bounces[at]dbmail.org] Im Auftrag von Andreja Babic
Gesendet: Donnerstag, 28. Mai 2009 09:37
An: DBMail mailinglist
Betreff: Re: [Dbmail] dbmail performance test

Hi Jon,

Interesting idea. I will do so and let you know the results.

Andreja

-----Urspr�ngliche Nachricht-----
Von: dbmail-bounces[at]dbmail.org [mailto:dbmail-bounces[at]dbmail.org] Im Auftrag von Jonathan Feally
Gesendet: Donnerstag, 28. Mai 2009 03:46
An: DBMail mailinglist
Betreff: Re: [Dbmail] dbmail performance test

It would be very nice if you were to compare the new 2.3.x from git vs.
2.2.x. I suspect that the size of the database will be much less than
your 2.2 install and would like to see what performance difference there
really is. If you were to run this test, please copy all the messages
into a fresh database vs. converting a copy of your 2.2 database. That
way all messages are stored in the single-instance-storage and all
header caching is done in a single table.

Thanks,
-Jon

Andreja Babic wrote:
> Hi,
>
> I am using dbmail for several years. Recently I have made performance
> test of dbmail and cyrus. I have 350 users in dbmail with total 4
> million mails.
> The biggest mailbox has a bit more than 150000 mails.
>
> Then I created the same users for cyrus and with imapsync copied all
> mails from dbmail to cyrus. Yes, it took few days to finish.
>
> This is an test environment so I had exclusive access to it.
>
> Dbmail version 2.2.11 compiled from source
> Cyrus version 2.2.13-14+b3 (debian package)
>
> Both imaps use mysql for authentication.
>
> Database dbmail took 48G while cyrus mail storage had 30G for the same
> amount of mails.
>
> I run simple test with expect scripts and measuring time difference
> between establishing and closing connection to each imap.
>
> What I have got from tests is that search is much faster on dbmail and
> fetch is much faster on cyrus.
>
> For example on the mailbox which had 39661 unread mails search on cyrus
> imap took 20 seconds. The same operation on identical mailbox on
> dbmail took 12.7 seconds.
>
> On the other side, fetching headers from all mails in inbox with "fetch
> 1:* body[header]" took on dbmail 20 seconds while the same operation
> on cyrus took 3 seconds.
>
> I want to point that originaly I had mysql parameter tmp_table_size set
> to 30M and then search on dbmail took ages on 3000 big maibox.
> After I increased this parameter to 500M search was flying and tests
> mentioned above are done when tmp_table_size was set to 500M.
>
> I am using roundcube webmail as front end for dbmail imap server and
> after login it takes ages to open huge mailbox. I would appreciate if
> you know and tell me if there is any "trick" to increase speed of fetch
> on dbmail.
>
>
> Regards,
>
> Andreja
> _______________________________________________
> DBmail mailing list
> DBmail[at]dbmail.org
> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
>
>

--
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.

_______________________________________________
DBmail mailing list
DBmail[at]dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
_______________________________________________
DBmail mailing list
DBmail[at]dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
_______________________________________________
DBmail mailing list
DBmail[at]dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

vulture at netvulture

Jun 3, 2009, 9:27 PM

Post #9 of 9 (683 views)
Permalink

Re: dbmail performance test [In reply to]

libzdb-2.4 will work fine with the latest git. It may have issues with
2.3.5 release.

Download link: http://www.tildeslash.com/libzdb/dist/libzdb-2.4.tar.gz
2.2 link: http://www.tildeslash.com/libzdb/dist/libzdb-2.2.tar.gz

Give that a shot.

-Jon

Andreja Babic wrote:
> Hi guys,
>
> I am trying to install dbmail-2.3.5 but without success by now.
>
> What I tried is to install is dbmail-2.3.5 + libzdb-2.5. As there is no libzdb debian package for debian-5.0 I have installed libzdb from source. But, after all I got an error while doing "make all":
>
> ----error----
> _db.c -fPIC -DPIC -o .libs/libdbmail_la-dm_db.o
> dm_db.c: In function 'db_connect':
> dm_db.c:200: warning: comparison between signed and unsigned
> dm_db.c: In function 'db_exec':
> dm_db.c:315: error: void value not ignored as it ought to be
> dm_db.c: In function 'db_stmt_set_str':
> dm_db.c:398: error: void value not ignored as it ought to be
> dm_db.c: In function 'db_stmt_set_int':
> dm_db.c:403: error: void value not ignored as it ought to be
> dm_db.c: In function 'db_stmt_set_u64':
> dm_db.c:408: error: void value not ignored as it ought to be
> dm_db.c: In function 'db_stmt_set_blob':
> dm_db.c:413: error: void value not ignored as it ought to be
> dm_db.c: In function 'db_stmt_exec':
> dm_db.c:417: error: void value not ignored as it ought to be
> dm_db.c: In function 'db_begin_transaction':
> dm_db.c:477: error: invalid use of void expression
> dm_db.c: In function 'db_commit_transaction':
> dm_db.c:485: error: invalid use of void expression
> dm_db.c: In function 'db_rollback_transaction':
> dm_db.c:496: error: invalid use of void expression
> dm_db.c: In function 'user_idnr_is_delivery_user_idnr':
> dm_db.c:795: warning: dereferencing type-punned pointer will break strict-aliasing rules
> dm_db.c:798: warning: dereferencing type-punned pointer will break strict-aliasing rules
> make[3]: *** [libdbmail_la-dm_db.lo] Error 1
> make[3]: Leaving directory `/usr/local/src/dbmail-2.3.5/src'
> make[2]: *** [all-recursive] Error 1
> make[2]: Leaving directory `/usr/local/src/dbmail-2.3.5/src'
> make[1]: *** [all-recursive] Error 1
> make[1]: Leaving directory `/usr/local/src/dbmail-2.3.5'
> make: *** [all] Error 2
> ----error----
>
> then I found this thread : http://www.nabble.com/problem-compiling-2.3.5-with-libzdb-2.4-(trunk)-td21558842.html where Paul says that libzdb-2.2 should be used.
>
> On official site of libzdb there is no chance to download required version: http://www.tildeslash.com/libzdb/download.html and I found this option:
>
> # svn list http://libzdb.googlecode.com/svn/tags/
> release-2-2/
> release-2-2-1/
> release-2-2-2/
> release-2-2-3/
> release-2-3/
> release-2-4/
> release-2-5/
>
> So, at the end I downloaded required version of libzdb from here svn checkout http://libzdb.googlecode.com/svn/tags/release-2-2 libzdb-2-2
>
> but there is no configure file. I am stuck here. Any help would be appreciated.
>
> Thanks in advance,
>
> Andreja
>
> -----Urspr�ngliche Nachricht-----
> Von: dbmail-bounces[at]dbmail.org [mailto:dbmail-bounces[at]dbmail.org] Im Auftrag von Andreja Babic
> Gesendet: Donnerstag, 28. Mai 2009 09:37
> An: DBMail mailinglist
> Betreff: Re: [Dbmail] dbmail performance test
>
> Hi Jon,
>
> Interesting idea. I will do so and let you know the results.
>
> Andreja
>
> -----Urspr�ngliche Nachricht-----
> Von: dbmail-bounces[at]dbmail.org [mailto:dbmail-bounces[at]dbmail.org] Im Auftrag von Jonathan Feally
> Gesendet: Donnerstag, 28. Mai 2009 03:46
> An: DBMail mailinglist
> Betreff: Re: [Dbmail] dbmail performance test
>
> It would be very nice if you were to compare the new 2.3.x from git vs.
> 2.2.x. I suspect that the size of the database will be much less than
> your 2.2 install and would like to see what performance difference there
> really is. If you were to run this test, please copy all the messages
> into a fresh database vs. converting a copy of your 2.2 database. That
> way all messages are stored in the single-instance-storage and all
> header caching is done in a single table.
>
> Thanks,
> -Jon
>
>
> Andreja Babic wrote:
>
>> Hi,
>>
>> I am using dbmail for several years. Recently I have made performance
>> test of dbmail and cyrus. I have 350 users in dbmail with total 4
>> million mails.
>> The biggest mailbox has a bit more than 150000 mails.
>>
>> Then I created the same users for cyrus and with imapsync copied all
>> mails from dbmail to cyrus. Yes, it took few days to finish.
>>
>> This is an test environment so I had exclusive access to it.
>>
>> Dbmail version 2.2.11 compiled from source
>> Cyrus version 2.2.13-14+b3 (debian package)
>>
>> Both imaps use mysql for authentication.
>>
>> Database dbmail took 48G while cyrus mail storage had 30G for the same
>> amount of mails.
>>
>> I run simple test with expect scripts and measuring time difference
>> between establishing and closing connection to each imap.
>>
>> What I have got from tests is that search is much faster on dbmail and
>> fetch is much faster on cyrus.
>>
>> For example on the mailbox which had 39661 unread mails search on cyrus
>> imap took 20 seconds. The same operation on identical mailbox on
>> dbmail took 12.7 seconds.
>>
>> On the other side, fetching headers from all mails in inbox with "fetch
>> 1:* body[header]" took on dbmail 20 seconds while the same operation
>> on cyrus took 3 seconds.
>>
>> I want to point that originaly I had mysql parameter tmp_table_size set
>> to 30M and then search on dbmail took ages on 3000 big maibox.
>> After I increased this parameter to 500M search was flying and tests
>> mentioned above are done when tmp_table_size was set to 500M.
>>
>> I am using roundcube webmail as front end for dbmail imap server and
>> after login it takes ages to open huge mailbox. I would appreciate if
>> you know and tell me if there is any "trick" to increase speed of fetch
>> on dbmail.
>>
>>
>> Regards,
>>
>> Andreja
>> _______________________________________________
>> DBmail mailing list
>> DBmail[at]dbmail.org
>> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
>>
>>
>>
>
>
>

__________ Information from ESET Smart Security, version of virus signature database 4129 (20090604) __________

The message was checked by ESET Smart Security.

http://www.eset.com

--
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.

_______________________________________________
DBmail mailing list
DBmail[at]dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact lists@gossamer-threads.com