bugtrack at dbmail
Dec 2, 2009, 7:48 AM
Post #1 of 3
(716 views)
Permalink
|
|
[DBMail 0000802]: Memory leak in IMAPd, DBmail v 2.3.6
|
|
A NOTE has been added to this issue.
======================================================================
http://dbmail.org/mantis/view.php?id=802
======================================================================
Reported By: tabrisnet
Assigned To: paul
======================================================================
Project: DBMail
Issue ID: 802
Category: IMAP daemon
Reproducibility: sometimes
Severity: crash
Priority: normal
Status: acknowledged
target:
======================================================================
Date Submitted: 29-Aug-09 20:39 CEST
Last Modified: 02-Dec-09 16:48 CET
======================================================================
Summary: Memory leak in IMAPd, DBmail v 2.3.6
Description:
While importing mail from previous mail store to DBmail 2.3.6 on MySQL
using imapsync, I have found that dbmail-imapd will leak memory. I have
seen it up to 2GB.
======================================================================
----------------------------------------------------------------------
(0002912) paul (administrator) - 31-Aug-09 09:37
http://dbmail.org/mantis/view.php?id=802#c2912
----------------------------------------------------------------------
Please run dbmail-imapd using valgrind.
Without valgrind logs, there's not much we can do.
----------------------------------------------------------------------
(0002913) tabrisnet (reporter) - 01-Sep-09 03:07
http://dbmail.org/mantis/view.php?id=802#c2913
----------------------------------------------------------------------
Find said file attached. Note that the crashes don't always happen, but
they do sometimes happen outside valgrind.
----------------------------------------------------------------------
(0002914) tabrisnet (reporter) - 01-Sep-09 03:29
http://dbmail.org/mantis/view.php?id=802#c2914
----------------------------------------------------------------------
Worth noting that it doesn't look that bad in the trace logs I'm reading.
I'm trying a different set of folders to sync, should transfer a lot more
data. I have a _lot_ of email to sync... albeit at this point it's looking
less and less likely that I'm going to try to use dbmail 2.3 in production
(for my personal use). Still, I have enough email that I can probably keep
working on debugging for a while.
----------------------------------------------------------------------
(0002915) tabrisnet (reporter) - 01-Sep-09 17:13
http://dbmail.org/mantis/view.php?id=802#c2915
----------------------------------------------------------------------
Second log has actual 'definitely lost' bytes, albeit it's still measured
in megabytes not gigabytes.
I had to compress it as this one was 4x larger than the previous one.
----------------------------------------------------------------------
(0002916) tabrisnet (reporter) - 02-Sep-09 19:15
http://dbmail.org/mantis/view.php?id=802#c2916
----------------------------------------------------------------------
This 3rd one should be more interesting. 2MB definitely lost, 100MB
possibly lost, and 760MB still reachable! Total size 876MB.
Large proportion of the 760 is hash table entries (from gmime).
Again had to compress, as the maximum file size is 50k and this one was
60k
----------------------------------------------------------------------
(0002917) paul (administrator) - 02-Sep-09 19:46
http://dbmail.org/mantis/view.php?id=802#c2917
----------------------------------------------------------------------
Ok, this last logfile appears to offer sufficient clues to close a number
of leaks.
----------------------------------------------------------------------
(0002921) tabrisnet (reporter) - 08-Sep-09 16:20
http://dbmail.org/mantis/view.php?id=802#c2921
----------------------------------------------------------------------
It appears that 2.2 may have the same bug[s]. It normally hasn't happened
to me due to the fact that I had set the per-process job limit to 2 and
such large importations of email isn't the common use-case.'
But I do right now have a 2.2.11 build with a virt-size of 770M and RSS of
760M.
----------------------------------------------------------------------
(0002947) pschmiel (reporter) - 02-Dec-09 16:48
http://dbmail.org/mantis/view.php?id=802#c2947
----------------------------------------------------------------------
I lose about 800M mem per day with latest GIT head. valgrind log is
attached.
Issue History
Date Modified Username Field Change
======================================================================
29-Aug-09 20:39 tabrisnet New Issue
31-Aug-09 09:37 paul Note Added: 0002912
31-Aug-09 09:37 paul Status new => feedback
01-Sep-09 03:05 tabrisnet File Added: dbmail-imapd.valgrind.log
01-Sep-09 03:07 tabrisnet Note Added: 0002913
01-Sep-09 03:29 tabrisnet Note Added: 0002914
01-Sep-09 17:12 tabrisnet File Added: dbmail-imapd.valgrind-2.log.bz2
01-Sep-09 17:13 tabrisnet Note Added: 0002915
02-Sep-09 19:08 tabrisnet File Added: dbmail-imapd.valgrind-3.log.bz2
02-Sep-09 19:15 tabrisnet Note Added: 0002916
02-Sep-09 19:45 paul Status feedback => assigned
02-Sep-09 19:45 paul Assigned To => paul
02-Sep-09 19:46 paul Note Added: 0002917
02-Sep-09 19:46 paul Status assigned =>
acknowledged
07-Sep-09 17:36 jasb Issue Monitored: jasb
08-Sep-09 16:20 tabrisnet Note Added: 0002921
09-Sep-09 13:25 heisenberg Issue Monitored: heisenberg
02-Dec-09 16:48 pschmiel Note Added: 0002947
======================================================================
_______________________________________________
Dbmail-dev mailing list
Dbmail-dev [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev
|
