Mailing List Archive: DBMail: users

imapd Temporary files

Index | Next | Previous | View Threaded

h.reindl at thelounge

Aug 12, 2009, 1:31 AM

Post #1 of 9 (1243 views)
Permalink

imapd Temporary files

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Has anybody an idea if there is a screw to reduce temp-usage

Last friday the disk was full and i had to restart dbmail-imapd
There are many files which are "deleted" and only seen with lsof

/dev/sde1 ext4 7,9G 5,0G 3,0G 63% /tmp

[root [at] mai:~]$ ls /tmp
insgesamt 8,0K
drwx------ 2 root root 4,0K 2009-08-11 16:20 kde-root
drwx------ 2 root root 4,0K 2009-08-11 16:20 ksocket-root
- -rw-r----- 1 apache apache 0 2009-08-11 16:08 resource.dir
- -rw------- 1 dbmail dbmail 0 2009-08-11 02:39 dbmail_scoreboard_5419.LCK
- -rw------- 1 dbmail dbmail 0 2009-08-11 02:39 dbmail_scoreboard_5442.LCK
- -rw------- 1 dbmail dbmail 0 2009-08-11 02:39 dbmail_scoreboard_5464.LCK
- -rw------- 1 dbmail dbmail 0 2009-08-11 02:39 dbmail_scoreboard_5486.LCK
- -rw-r----- 1 apache apache 0 2009-08-11 16:08 resource.pag

dbmail-im 4341 dbmail 16u REG 8,65 159892 516
/tmp/tmpfeenag5 (deleted)
dbmail-im 4341 dbmail 17u REG 8,65 128486 515
/tmp/tmpf9oJtjN (deleted)
dbmail-im 4341 dbmail 18u REG 8,65 582654 518
/tmp/tmpfEnG9NX (deleted)
dbmail-im 4341 dbmail 19u REG 8,65 217507 523
/tmp/tmpf8lCUed (deleted)
dbmail-im 4341 dbmail 20u REG 8,65 99316 524
/tmp/tmpfzrpnI8 (deleted)
dbmail-im 4341 dbmail 21u REG 8,65 89995 532
/tmp/tmpfxyhF3m (deleted)
dbmail-im 4341 dbmail 22u REG 8,65 1088336 540
/tmp/tmpfyKHmyP (deleted)
dbmail-im 4341 dbmail 23u REG 8,65 1254005 542
/tmp/tmpfZLavMT (deleted)
dbmail-im 4341 dbmail 24u REG 8,65 761572 543
/tmp/tmpfhEtpEp (deleted)
dbmail-im 4341 dbmail 25u REG 8,65 1676555 544
/tmp/tmpfEsYZki (deleted)
dbmail-im 4341 dbmail 26u REG 8,65 1437750 545
/tmp/tmpfKHsGDT (deleted)
dbmail-im 4341 dbmail 27u REG 8,65 1676613 546
/tmp/tmpfKJkKEv (deleted)
dbmail-im 4341 dbmail 28u REG 8,65 3766939 547
/tmp/tmpfUj0fBR (deleted)
dbmail-im 4341 dbmail 29u REG 8,65 1750956 548
/tmp/tmpf3J9S2C (deleted)
dbmail-im 4341 dbmail 30u REG 8,65 1402356 549
/tmp/tmpfuEdR67 (deleted)
dbmail-im 4341 dbmail 31u REG 8,65 1402377 550
/tmp/tmpfRjj5M1 (deleted)
dbmail-im 4341 dbmail 32u REG 8,65 1384111 551
/tmp/tmpf8cWA5X (deleted)
dbmail-im 4341 dbmail 33u REG 8,65 1331224 552
/tmp/tmpfUWy32B (deleted)
dbmail-im 4341 dbmail 34u REG 8,65 1402377 553
/tmp/tmpfmafSZZ (deleted)
dbmail-im 4341 dbmail 35u REG 8,65 1402356 554
/tmp/tmpfYsqDts (deleted)
dbmail-im 4341 dbmail 36u REG 8,65 3766939 555
/tmp/tmpfaDIL1Y (deleted)
dbmail-im 4341 dbmail 37u REG 8,65 1750956 556
/tmp/tmpf5UlbWA (deleted)
dbmail-im 4341 dbmail 38u REG 8,65 1676555 557
/tmp/tmpfkP6xEh (deleted)
dbmail-im 4341 dbmail 39u REG 8,65 1437750 558
/tmp/tmpfs5K432 (deleted)
dbmail-im 4341 dbmail 40u REG 8,65 1676613 559
/tmp/tmpfie5ZMS (deleted)
dbmail-im 4341 dbmail 41u REG 8,65 1254005 560
/tmp/tmpfIxTMlN (deleted)
dbmail-im 4341 dbmail 42u REG 8,65 99316 561
/tmp/tmpf25hBtM (deleted)
dbmail-im 4341 dbmail 43u REG 8,65 1088336 562
/tmp/tmpf6K2UHL (deleted)
dbmail-im 4341 dbmail 44u REG 8,65 161266 563
/tmp/tmpfjAhhKO (deleted)
dbmail-im 4341 dbmail 45u REG 8,65 128486 564
/tmp/tmpfpoljSR (deleted)
dbmail-im 4341 dbmail 46u REG 8,65 217507 565
/tmp/tmpfES234U (deleted)
dbmail-im 4341 dbmail 47u REG 8,65 582654 566
/tmp/tmpfhucGpY (deleted)
dbmail-im 4341 dbmail 48u REG 8,65 99503 567
/tmp/tmpfbDBdd5 (deleted)
dbmail-im 4341 dbmail 49u REG 8,65 159892 568
/tmp/tmpfVXHA6b (deleted)
dbmail-im 4341 dbmail 50u REG 8,65 582654 569
/tmp/tmpfIIeP5i (deleted)
dbmail-im 4341 dbmail 51u REG 8,65 1088336 570
/tmp/tmpfQikwnq (deleted)
dbmail-im 4341 dbmail 52u REG 8,65 1254005 571
/tmp/tmpf2u8h9x (deleted)

- --

Reindl Harald
the lounge interactive design GmbH
A-1060 Vienna | Hofmühlgasse 17
software-development / cms-solutions

phone: +43 (1) 595 3999 33
cellular: +43 (676) 40 221 40
icq: 154546673

mailto:h.reindl [at] thelounge
http://www.thelounge.net/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Remi - http://enigmail.mozdev.org

iEYEARECAAYFAkqCffkACgkQhmBjz394Anmv9QCfWTUNdFsR0fgic/OcgpnjGOLM
F2YAnAsCquu2VlxopYFq2Gh5WF1atgml
=wbYC
-----END PGP SIGNATURE-----
_______________________________________________
DBmail mailing list
DBmail [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

michael.monnerie at is

Aug 12, 2009, 2:14 AM

Post #2 of 9 (1177 views)
Permalink

Re: imapd Temporary files [In reply to]

On Mittwoch 12 August 2009 Reindl Harald wrote:
> Has anybody an idea if there is a screw to reduce temp-usage
>
> Last friday the disk was full and i had to restart dbmail-imapd
> There are many files which are "deleted" and only seen with lsof

I think the only thing is to resize that partition or move /tmp to
another disk and connect via symlink.

mfg zmi
--
// Michael Monnerie, Ing.BSc ----- http://it-management.at
// Tel: 0660 / 415 65 31 .network.your.ideas.
// PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import"
// Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4
// Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4

Attachments:

signature.asc (0.19 KB)

h.reindl at thelounge

Aug 12, 2009, 2:17 AM

Post #3 of 9 (1176 views)
Permalink

Re: imapd Temporary files [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hm - I think there is a bug because the files are marked as deleted but
space is allocated

Michael Monnerie schrieb:
> On Mittwoch 12 August 2009 Reindl Harald wrote:
>> Has anybody an idea if there is a screw to reduce temp-usage
>>
>> Last friday the disk was full and i had to restart dbmail-imapd
>> There are many files which are "deleted" and only seen with lsof
>
> I think the only thing is to resize that partition or move /tmp to
> another disk and connect via symlink.
>
> mfg zmi
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> DBmail mailing list
> DBmail [at] dbmail
> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

- --

Reindl Harald
the lounge interactive design GmbH
A-1060 Vienna | Hofmühlgasse 17
software-development / cms-solutions

phone: +43 (1) 595 3999 33
cellular: +43 (676) 40 221 40
icq: 154546673

mailto:h.reindl [at] thelounge
http://www.thelounge.net/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Remi - http://enigmail.mozdev.org

iEYEARECAAYFAkqCiJkACgkQhmBjz394AnkC1wCfbzPgOpS+hicli7wB1zrBr4+b
o90An0WVYbXj9YLcn3hSH7ix0OJnbKae
=PbWt
-----END PGP SIGNATURE-----
_______________________________________________
DBmail mailing list
DBmail [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

paul at nfg

Aug 12, 2009, 2:45 AM

Post #4 of 9 (1176 views)
Permalink

Re: imapd Temporary files [In reply to]

Reindl,

This was discussed on the list some time ago. Please try searching the
list archives.

IIRC, It is a bug that is probably triggered by a very low value for
MAXCONNECTS in dbmail.conf

Reindl Harald wrote:
>
> Hm - I think there is a bug because the files are marked as deleted but
> space is allocated
>
>
> Michael Monnerie schrieb:
>> On Mittwoch 12 August 2009 Reindl Harald wrote:
>>> Has anybody an idea if there is a screw to reduce temp-usage
>>>
>>> Last friday the disk was full and i had to restart dbmail-imapd
>>> There are many files which are "deleted" and only seen with lsof
>> I think the only thing is to resize that partition or move /tmp to
>> another disk and connect via symlink.
>
>> mfg zmi
>
>
>> ------------------------------------------------------------------------
>
>> _______________________________________________
>> DBmail mailing list
>> DBmail [at] dbmail
>> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
>
_______________________________________________
DBmail mailing list
DBmail [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

--
________________________________________________________________
Paul Stevens paul at nfg.nl
NET FACILITIES GROUP GPG/PGP: 1024D/11F8CD31
The Netherlands________________________________http://www.nfg.nl
_______________________________________________
DBmail mailing list
DBmail [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

michael.monnerie at is

Aug 12, 2009, 2:49 AM

Post #5 of 9 (1178 views)
Permalink

Re: imapd Temporary files [In reply to]

On Mittwoch 12 August 2009 Reindl Harald wrote:
> Hm - I think there is a bug because the files are marked as deleted
> but space is allocated

No, that is intended. This is a security measure, as nobody else can
access the files anymore. As soon as you stop the daemons, the space
will be freed again.

mfg zmi
--
// Michael Monnerie, Ing.BSc ----- http://it-management.at
// Tel: 0660 / 415 65 31 .network.your.ideas.
// PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import"
// Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4
// Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4

Attachments:

signature.asc (0.19 KB)

h.reindl at thelounge

Aug 12, 2009, 2:51 AM

Post #6 of 9 (1185 views)
Permalink

Re: imapd Temporary files [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Paul J Stevens schrieb:

> This was discussed on the list some time ago. Please try searching the
> list archives.
>
> IIRC, It is a bug that is probably triggered by a very low value for
> MAXCONNECTS in dbmail.conf

Hi

As the disk ran full it was configured to 1000 and i configured to 25 because i am hoping
that the processes owning the temp-files will die earlier, but there are also 5 GB of
deleted temp-data

What is wrong in my logic?
If i restart imapd all space gets free because the processes are dying

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Remi - http://enigmail.mozdev.org

iEYEARECAAYFAkqCkKwACgkQhmBjz394AnkLrQCfUQQYGZKb7m7+wnoGAPsRurvP
25AAnj3HK3Rt/uSapggIidTbkczHFlUE
=IJl6
-----END PGP SIGNATURE-----
_______________________________________________
DBmail mailing list
DBmail [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

paul at nfg

Aug 12, 2009, 3:02 AM

Post #7 of 9 (1178 views)
Permalink

Re: imapd Temporary files [In reply to]

Reindl Harald wrote:
>
> Paul J Stevens schrieb:
>
>> This was discussed on the list some time ago. Please try searching the
>> list archives.
>
>> IIRC, It is a bug that is probably triggered by a very low value for
>> MAXCONNECTS in dbmail.conf
>
> Hi
>
> As the disk ran full it was configured to 1000 and i configured to 25 because i am hoping
> that the processes owning the temp-files will die earlier, but there are also 5 GB of
> deleted temp-data
>
> What is wrong in my logic?
> If i restart imapd all space gets free because the processes are dying

increase MAXCONNECTS to 10000 so child processes live longer.

On my own main server I use 100 and don't see anything like the
described behaviour, so I'm guessing this may well be a race condition
(bug) in the 2.2 code that is triggered under heavy loads (which I
seldom have).

--
________________________________________________________________
Paul Stevens paul at nfg.nl
NET FACILITIES GROUP GPG/PGP: 1024D/11F8CD31
The Netherlands________________________________http://www.nfg.nl
_______________________________________________
DBmail mailing list
DBmail [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

michael.monnerie at is

Aug 12, 2009, 3:07 AM

Post #8 of 9 (1176 views)
Permalink

Re: imapd Temporary files [In reply to]

On Mittwoch 12 August 2009 Reindl Harald wrote:
> As the disk ran full it was configured to 1000 and i configured to 25
> because i am hoping that the processes owning the temp-files will die
> earlier, but there are also 5 GB of deleted temp-data
>
> What is wrong in my logic?
> If i restart imapd all space gets free because the processes are
> dying

http://www.mail-archive.com/dbmail [at] dbmail/msg16123.html

A bit of /tmp use is normal, I thought you just had a lot of imapd
processes and that takes more space then.

mfg zmi
--
// Michael Monnerie, Ing.BSc ----- http://it-management.at
// Tel: 0660 / 415 65 31 .network.your.ideas.
// PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import"
// Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4
// Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4

_______________________________________________
DBmail mailing list
DBmail [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

h.reindl at thelounge

Aug 12, 2009, 3:18 AM

Post #9 of 9 (1173 views)
Permalink

Re: imapd Temporary files [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Paul J Stevens schrieb:

First:
Thank you for the great software and yes i know that it is not easy to get away all bugs
in all situations because i'm web-developer and i say only "ms internet explorer"

I love the idea to have all in a database and can make own interfaces

> On my own main server I use 100 and don't see anything like the
> described behaviour, so I'm guessing this may well be a race condition
> (bug) in the 2.2 code that is triggered under heavy loads (which I
> seldom have).

This could be true, i have no statistics, but looking at the logfile shows me that there
are really much imap/pop3 logins the whole time. As the disk ran full there were hundrets
of bounces from a mailing-list incoming

BTW:
"/etc/init.d dbmail-imapd reload" kills the imapd
Restart also if i do not change the init-script to
* start
* sleep 4
* stop

Restarting says there is a process listening
So seems the new daemon starts shortly before the old finished dying

- --

Reindl Harald
the lounge interactive design GmbH
A-1060 Vienna | Hofmühlgasse 17
software-development / cms-solutions

phone: +43 (1) 595 3999 33
cellular: +43 (676) 40 221 40
icq: 154546673

mailto:h.reindl [at] thelounge
http://www.thelounge.net/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Remi - http://enigmail.mozdev.org

iEYEARECAAYFAkqCluQACgkQhmBjz394AnlUUQCdEF13mNLpSFrXFAqa//ctE9Bq
VFkAoICxo1CCeQ2Ob53zmXa5fQRLPITX
=C1G1
-----END PGP SIGNATURE-----
_______________________________________________
DBmail mailing list
DBmail [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads