Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: DBMail: dev

[DBMail 0000897]: dbmail-util creates duplicate entries in dbmail_envelope

  

 
DBMail dev RSS feed   Index | Next | Previous | View Threaded


bugtrack at dbmail

Feb 13, 2012, 1:20 PM

Post #1 of 12 (440 views)
Permalink
[DBMail 0000897]: dbmail-util creates duplicate entries in dbmail_envelope
The following issue has been RESOLVED.
======================================================================
http://www.dbmail.org/mantis/view.php?id=897
======================================================================
Reported By: simkin
Assigned To:
======================================================================
Project: DBMail
Issue ID: 897
Category: Command-Line programs (dbmail-users, dbmail-util)
Reproducibility: always
Severity: major
Priority: normal
Status: resolved
target:
Resolution: fixed
Fixed in Version: 3.0.1
======================================================================
Date Submitted: 19-Apr-11 19:14 CEST
Last Modified: 13-Feb-12 22:20 CET
======================================================================
Summary: dbmail-util creates duplicate entries in
dbmail_envelope
Description:
During the upgrade to 3.0.0, the header cache is deleted and must be
repopulated with dbmail-util.

This task causes duplicate entries to be added to dbmail_envelope because
the header cache function inserts an entry here regardless of whether it
exists - and even if you empty dbmail_envelope prior to running dbmail -by,
it firsts refills the envelope cache and then adds duplicate entries while
populating the header cache.
======================================================================

----------------------------------------------------------------------
(0003210) lemmster (reporter) - 06-Jul-11 10:14
http://www.dbmail.org/mantis/view.php?id=897#c3210
----------------------------------------------------------------------
Same happens here with MySQL and a fresh 3.0 database (not migration from
2.2 to 3.0).

Issue History
Date Modified Username Field Change
======================================================================
19-Apr-11 19:14 simkin New Issue
19-Apr-11 20:08 simkin Issue Monitored: simkin
06-Jul-11 10:14 lemmster Issue Monitored: lemmster
06-Jul-11 10:14 lemmster Note Added: 0003210
13-Feb-12 22:20 paul Status new => resolved
13-Feb-12 22:20 paul Resolution open => fixed
13-Feb-12 22:20 paul Fixed in Version => 3.0.1
======================================================================

_______________________________________________
Dbmail-dev mailing list
Dbmail-dev [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev


mysql.jorge at decimal

Feb 13, 2012, 2:51 PM

Post #2 of 12 (402 views)
Permalink
Re: [DBMail 0000897]: dbmail-util creates duplicate entries in dbmail_envelope [In reply to]
Paul,

This bug may explain why I can't apply the:

CREATE UNIQUE INDEX dbmail_envelope_1 ON dbmail_envelope(physmessage_id);

Of the file: 2_3_6-3_0_0.mysql

What do you recommend to search & delete the duplicated info, without
recreate the cache?
I'm with 110GB right now, and if I can bypass the cache recreate would be
good to not having the service down.

> -----Original Message-----
> From: dbmail-dev-bounces [at] dbmail [mailto:dbmail-dev-
> bounces [at] dbmail] On Behalf Of Mantis Bug Tracker
> Sent: segunda-feira, 13 de Fevereiro de 2012 21:21
> To: dbmail-dev [at] dbmail
> Subject: [Dbmail-dev] [DBMail 0000897]: dbmail-util creates duplicate
> entries in dbmail_envelope
>
>
> The following issue has been RESOLVED.
> ======================================================================
> http://www.dbmail.org/mantis/view.php?id=897
> ======================================================================
> Reported By: simkin
> Assigned To:
> ======================================================================
> Project: DBMail
> Issue ID: 897
> Category: Command-Line programs (dbmail-users,
> dbmail-util)
> Reproducibility: always
> Severity: major
> Priority: normal
> Status: resolved
> target:
> Resolution: fixed
> Fixed in Version: 3.0.1
> ======================================================================
> Date Submitted: 19-Apr-11 19:14 CEST
> Last Modified: 13-Feb-12 22:20 CET
> ======================================================================
> Summary: dbmail-util creates duplicate entries in
> dbmail_envelope
> Description:
> During the upgrade to 3.0.0, the header cache is deleted and must be
> repopulated with dbmail-util.
>
> This task causes duplicate entries to be added to dbmail_envelope
> because
> the header cache function inserts an entry here regardless of whether
> it
> exists - and even if you empty dbmail_envelope prior to running dbmail
> -by,
> it firsts refills the envelope cache and then adds duplicate entries
> while
> populating the header cache.
> ======================================================================
>
> ----------------------------------------------------------------------
> (0003210) lemmster (reporter) - 06-Jul-11 10:14
> http://www.dbmail.org/mantis/view.php?id=897#c3210
> ----------------------------------------------------------------------
> Same happens here with MySQL and a fresh 3.0 database (not migration
> from
> 2.2 to 3.0).
>
> Issue History
> Date Modified Username Field Change
> ======================================================================
> 19-Apr-11 19:14 simkin New Issue
> 19-Apr-11 20:08 simkin Issue Monitored: simkin
> 06-Jul-11 10:14 lemmster Issue Monitored: lemmster
> 06-Jul-11 10:14 lemmster Note Added: 0003210
> 13-Feb-12 22:20 paul Status new =>
> resolved
> 13-Feb-12 22:20 paul Resolution open => fixed
> 13-Feb-12 22:20 paul Fixed in Version => 3.0.1
> ======================================================================
>
> _______________________________________________
> Dbmail-dev mailing list
> Dbmail-dev [at] dbmail
> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev

_______________________________________________
Dbmail-dev mailing list
Dbmail-dev [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev


paul at nfg

Feb 14, 2012, 12:49 AM

Post #3 of 12 (406 views)
Permalink
Re: [DBMail 0000897]: dbmail-util creates duplicate entries in dbmail_envelope [In reply to]
On 02/13/2012 11:51 PM, Jorge Bastos wrote:
> Paul,
>
> This bug may explain why I can't apply the:

Indeed.

> CREATE UNIQUE INDEX dbmail_envelope_1 ON dbmail_envelope(physmessage_id);
>
> Of the file: 2_3_6-3_0_0.mysql
>
> What do you recommend to search & delete the duplicated info, without
> recreate the cache?
> I'm with 110GB right now, and if I can bypass the cache recreate would be
> good to not having the service down.

Do a 'truncated table dbmail_envelope' and add the above index right
away. Then run dbmail-util -by to recreate the cached envelopes.

This will only affect IMAP users.






--
________________________________________________________________
Paul J Stevens pjstevns @ gmail, twitter, skype, linkedin

* Premium Hosting Services and Web Application Consultancy *

www.nfg.nl/info [at] nfg/+31.85.877.99.97
________________________________________________________________
_______________________________________________
Dbmail-dev mailing list
Dbmail-dev [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev


mysql.jorge at decimal

Feb 14, 2012, 1:20 AM

Post #4 of 12 (405 views)
Permalink
Re: [DBMail 0000897]: dbmail-util creates duplicate entries in dbmail_envelope [In reply to]
> Do a 'truncated table dbmail_envelope' and add the above index right
> away. Then run dbmail-util -by to recreate the cached envelopes.
>
> This will only affect IMAP users.

Hum,

If that's the only way it'll be.
I do have several IMAP users, about 50% of them.

_______________________________________________
Dbmail-dev mailing list
Dbmail-dev [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev


paul at nfg

Feb 14, 2012, 1:45 AM

Post #5 of 12 (404 views)
Permalink
Re: [DBMail 0000897]: dbmail-util creates duplicate entries in dbmail_envelope [In reply to]
On 02/14/2012 10:20 AM, Jorge Bastos wrote:
>> Do a 'truncated table dbmail_envelope' and add the above index right
>> away. Then run dbmail-util -by to recreate the cached envelopes.
>>
>> This will only affect IMAP users.
>
> Hum,
>
> If that's the only way it'll be.
> I do have several IMAP users, about 50% of them.

They probably won't notice if you time it right.


--
________________________________________________________________
Paul J Stevens pjstevns @ gmail, twitter, skype, linkedin

* Premium Hosting Services and Web Application Consultancy *

www.nfg.nl/info [at] nfg/+31.85.877.99.97
________________________________________________________________
_______________________________________________
Dbmail-dev mailing list
Dbmail-dev [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev


mysql.jorge at decimal

Feb 14, 2012, 6:47 AM

Post #6 of 12 (398 views)
Permalink
Re: [DBMail 0000897]: dbmail-util creates duplicate entries in dbmail_envelope [In reply to]
> > If that's the only way it'll be.
> > I do have several IMAP users, about 50% of them.
>
> They probably won't notice if you time it right.

I understand, I'll do it on a Saturday/Sunday morning or so.

This time I'll do a parallel test before doing it on the main server, I'll
boot one of the disks of the array on another machine.

_______________________________________________
Dbmail-dev mailing list
Dbmail-dev [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev


dbmail at roeske-net

Feb 14, 2012, 7:40 AM

Post #7 of 12 (402 views)
Permalink
Re: [DBMail 0000897]: dbmail-util creates duplicate entries in dbmail_envelope [In reply to]
Hi,

>>> If that's the only way it'll be.
>>> I do have several IMAP users, about 50% of them.
>> They probably won't notice if you time it right.
> I understand, I'll do it on a Saturday/Sunday morning or so.
>
> This time I'll do a parallel test before doing it on the main server, I'll
> boot one of the disks of the array on another machine.
You can create a new table dbmail_envelope_new with the desired
structure and with the unique index applied.
Then use the query INSERT IGNORE INTO dbmail_envelope_new SELECT * FROM
dbmail_envelope.
After that you can delete the old table and rename dbmail_envelope_new
to dbmail_envelope.

But I do not know, how long renaming a InnoDB Table takes. If it creates
a temporary taple, this version is rather useless.
_______________________________________________
Dbmail-dev mailing list
Dbmail-dev [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev


mysql.jorge at decimal

Feb 14, 2012, 3:30 PM

Post #8 of 12 (395 views)
Permalink
Re: [DBMail 0000897]: dbmail-util creates duplicate entries in dbmail_envelope [In reply to]
> > > If that's the only way it'll be.
> > > I do have several IMAP users, about 50% of them.
> >
> > They probably won't notice if you time it right.
>
> I understand, I'll do it on a Saturday/Sunday morning or so.
>
> This time I'll do a parallel test before doing it on the main server,
> I'll
> boot one of the disks of the array on another machine.


Paul,

Can I have lmtp+pop3 up with activity, and only IMAP down while I'm
recreating the cache?

_______________________________________________
Dbmail-dev mailing list
Dbmail-dev [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev


paul at nfg

Feb 14, 2012, 11:58 PM

Post #9 of 12 (396 views)
Permalink
Re: [DBMail 0000897]: dbmail-util creates duplicate entries in dbmail_envelope [In reply to]
On 02/15/2012 12:30 AM, Jorge Bastos wrote:
>>>> If that's the only way it'll be.
>>>> I do have several IMAP users, about 50% of them.
>>>
>>> They probably won't notice if you time it right.
>>
>> I understand, I'll do it on a Saturday/Sunday morning or so.
>>
>> This time I'll do a parallel test before doing it on the main server,
>> I'll
>> boot one of the disks of the array on another machine.
>
>
> Paul,
>
> Can I have lmtp+pop3 up with activity, and only IMAP down while I'm
> recreating the cache?

Yes. But don't use the procedure Frank Röske proposed if you keep LMTP
running. Just use the upgrade script in GIT (to be in 3.0.1)


--
________________________________________________________________
Paul J Stevens pjstevns @ gmail, twitter, skype, linkedin

* Premium Hosting Services and Web Application Consultancy *

www.nfg.nl/info [at] nfg/+31.85.877.99.97
________________________________________________________________
_______________________________________________
Dbmail-dev mailing list
Dbmail-dev [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev


mysql.jorge at decimal

Feb 15, 2012, 1:22 AM

Post #10 of 12 (395 views)
Permalink
Re: [DBMail 0000897]: dbmail-util creates duplicate entries in dbmail_envelope [In reply to]
> > Can I have lmtp+pop3 up with activity, and only IMAP down while I'm
> > recreating the cache?
>
> Yes. But don't use the procedure Frank Röske proposed if you keep LMTP
> running. Just use the upgrade script in GIT (to be in 3.0.1)

Hum Paul,

I want be sure about this.
On my case, on the git version that I am, around 2.3.6 as stated previously,
I already added the upgrade info in the file "2_3_5-2_3_6.mysql", so I'm
only missing the index on "2_3_6-3_0_0.mysql".

So, Can I have at least POP3 running, and shutdown LMTP+IMAP during the
cache recreate?
This way, emails will be delivered later by postfix, and I'll keep POP3
users running without complains.

Can it be this way?

_______________________________________________
Dbmail-dev mailing list
Dbmail-dev [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev


paul at nfg

Feb 15, 2012, 1:33 AM

Post #11 of 12 (393 views)
Permalink
Re: [DBMail 0000897]: dbmail-util creates duplicate entries in dbmail_envelope [In reply to]
On 02/15/2012 10:22 AM, Jorge Bastos wrote:
>>> Can I have lmtp+pop3 up with activity, and only IMAP down while I'm
>>> recreating the cache?
>>
>> Yes. But don't use the procedure Frank Röske proposed if you keep LMTP
>> running. Just use the upgrade script in GIT (to be in 3.0.1)
>
> Hum Paul,
>
> I want be sure about this.
> On my case, on the git version that I am, around 2.3.6 as stated previously,
> I already added the upgrade info in the file "2_3_5-2_3_6.mysql", so I'm
> only missing the index on "2_3_6-3_0_0.mysql".

Of course.

> So, Can I have at least POP3 running, and shutdown LMTP+IMAP during the
> cache recreate?

Yes.

> This way, emails will be delivered later by postfix, and I'll keep POP3
> users running without complains.
>
> Can it be this way?

Yes.


--
________________________________________________________________
Paul J Stevens pjstevns @ gmail, twitter, skype, linkedin

* Premium Hosting Services and Web Application Consultancy *

www.nfg.nl/info [at] nfg/+31.85.877.99.97
________________________________________________________________
_______________________________________________
Dbmail-dev mailing list
Dbmail-dev [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev


mysql.jorge at decimal

Feb 15, 2012, 1:36 AM

Post #12 of 12 (394 views)
Permalink
Re: [DBMail 0000897]: dbmail-util creates duplicate entries in dbmail_envelope [In reply to]
Merci Paul!

> -----Original Message-----
> From: dbmail-dev-bounces [at] dbmail [mailto:dbmail-dev-
> bounces [at] dbmail] On Behalf Of Paul J Stevens
> Sent: quarta-feira, 15 de Fevereiro de 2012 09:33
> To: DBMAIL Developers Mailinglist
> Subject: Re: [Dbmail-dev] [DBMail 0000897]: dbmail-util creates
> duplicate entries in dbmail_envelope
>
> On 02/15/2012 10:22 AM, Jorge Bastos wrote:
> >>> Can I have lmtp+pop3 up with activity, and only IMAP down while I'm
> >>> recreating the cache?
> >>
> >> Yes. But don't use the procedure Frank Röske proposed if you keep
> >> LMTP running. Just use the upgrade script in GIT (to be in 3.0.1)
> >
> > Hum Paul,
> >
> > I want be sure about this.
> > On my case, on the git version that I am, around 2.3.6 as stated
> > previously, I already added the upgrade info in the file
> > "2_3_5-2_3_6.mysql", so I'm only missing the index on "2_3_6-
> 3_0_0.mysql".
>
> Of course.
>
> > So, Can I have at least POP3 running, and shutdown LMTP+IMAP during
> > the cache recreate?
>
> Yes.
>
> > This way, emails will be delivered later by postfix, and I'll keep
> > POP3 users running without complains.
> >
> > Can it be this way?
>
> Yes.
>
>
> --
> ________________________________________________________________
> Paul J Stevens pjstevns @ gmail, twitter, skype, linkedin
>
> * Premium Hosting Services and Web Application Consultancy *
>
> www.nfg.nl/info [at] nfg/+31.85.877.99.97
> ________________________________________________________________
> _______________________________________________
> Dbmail-dev mailing list
> Dbmail-dev [at] dbmail
> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev

_______________________________________________
Dbmail-dev mailing list
Dbmail-dev [at] dbmail
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev

DBMail dev RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.