
jj33 at pobox
Mar 23, 2011, 12:00 PM
Post #3 of 3
(282 views)
Permalink
|
|
Re: Exim test suite running thru Basic/0216
[In reply to]
|
|
On Tue, Mar 22, 2011 at 4:31 AM, Phil Pennock <exim-dev [at] spodhuis> wrote: > On 2011-01-30 at 03:58 -0500, Phil Pennock wrote: >> At 0217, things fail in such a way as to kill a daemon assumed to be >> running in later tests? Or something. I'm too tired at this point to >> debug further. > > Got around to tests before the final 4.75 cut. > > I can now get up to: ipliteral/5301 (ie, the end!) > > However, in addition to the LRU issues I noted before, I saw some more > issues which I continued past. > > These are the tests I haven't fixed and would like to know if the > failures are commonly observed. Took me a while to find my testing notes. My last successful testing was 2010-07-19 (and at a company I no longer work for, hence taking a while to find the notes) 0288 was testing cleanly for me at that time. I'm sorry but I can't provide any lib versions for the server I was using to test 0358 was broken back then. My notes say "line ordering" and that I sent an email to exim-dev on 2010-06-08 w/ no response. 0548 was likewise broken then. I don't have any notes about suspected cause. 1003, 1006, 1009 - I don't have any notes for these tests but I'm not 100% sure the IPv6 tests would have run on that machine. 2100 2101 2102 2111 2112 2114 2120 2124 2125 2127 - I had all of these flagged. my only comment was "new TLS disconnect string". 3650 - not sure I would have hit this test 5007 - my notes say I sent an email to exim-dev about this test on 2010-06-12, that may provide additional thoughts on this failure. Hope that helps. --John > > ----------------------------8< cut here >8------------------------------ > Basic/0288 serialize_hosts > ** Comparison of test-mainlog-munged with log/0288 failed=============== > From line 3 of "test-mainlog-munged" and line 3 of "log/0288" the files are different. > ---------- > 1999-03-02 09:44:33 Berkeley DB error: no absolute path for the current directory: No such file or directory > 1999-03-02 09:44:33 Berkeley DB error: Database handles still open at environment close > 1999-03-02 09:44:33 Berkeley DB error: no absolute path for the current directory: No such file or directory > 1999-03-02 09:44:33 Berkeley DB error: Database handles still open at environment close > 1999-03-02 09:44:33 10HmaX-0005vi-00 == b [at] test R=all T=smtp defer (-53): connection limit reached for all hosts > 1999-03-02 09:44:33 10HmaX-0005vi-00 => a [at] test R=all T=smtp H=127.0.0.1 [127.0.0.1] > 1999-03-02 09:44:33 End queue run: pid=pppp > ---------- > 1999-03-02 09:44:33 10HmaX-0005vi-00 == b [at] test R=all T=smtp defer (-53): connection limit reached for all hosts > 1999-03-02 09:44:33 10HmaX-0005vi-00 => a [at] test R=all T=smtp H=127.0.0.1 [127.0.0.1] > 1999-03-02 09:44:33 End queue run: pid=pppp > =============== > 1 difference found. > "test-mainlog-munged" contains 9 lines; "log/0288" contains 5 lines. > ----------------------------8< cut here >8------------------------------ > > ----------------------------8< cut here >8------------------------------ > Basic/0358 retrying address errors (not first address) > ** Comparison of test-stdout-munged with stdout/0358 failed=============== > Lines 2-9 of "test-stdout-munged" do not match lines 2-9 of "stdout/0358". > ---------- > R:usery [at] test:<CALLER [at] test> -44 13121 SMTP error from remote mail server after RCPT TO:<usery [at] test>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error > first failed = time last try = time2 next try = time2 + 1 > R:userx [at] test:<CALLER [at] test> -44 13121 SMTP error from remote mail server after RCPT TO:<userx [at] test>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error > first failed = time last try = time2 next try = time2 + 1 > +++++++++++++++++++++++++++ > R:usery [at] test:<CALLER [at] test> -44 13121 SMTP error from remote mail server after RCPT TO:<usery [at] test>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error > first failed = time last try = time2 next try = time2 + 2 > R:userx [at] test:<CALLER [at] test> -44 13121 SMTP error from remote mail server after RCPT TO:<userx [at] test>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error > ---------- > R:userx [at] test:<CALLER [at] test> -44 13121 SMTP error from remote mail server after RCPT TO:<userx [at] test>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error > first failed = time last try = time2 next try = time2 + 1 > R:usery [at] test:<CALLER [at] test> -44 13121 SMTP error from remote mail server after RCPT TO:<usery [at] test>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error > first failed = time last try = time2 next try = time2 + 1 > +++++++++++++++++++++++++++ > R:userx [at] test:<CALLER [at] test> -44 13121 SMTP error from remote mail server after RCPT TO:<userx [at] test>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error > first failed = time last try = time2 next try = time2 + 2 > R:usery [at] test:<CALLER [at] test> -44 13121 SMTP error from remote mail server after RCPT TO:<usery [at] test>: host 127.0.0.1 [127.0.0.1]: 451 Temporary error > =============== > 1 difference found. > "test-stdout-munged" contains 40 lines; "stdout/0358" contains 40 lines. > ----------------------------8< cut here >8------------------------------ > > Similar issues on 0548. > > ----------------------------8< cut here >8------------------------------ > Basic/0437 queue run: close lookups before delivery > ** Command 1 ("exim", starting at line 2) > ** Return code 1 (expected 0) > show stdErr, show stdOut, Continue (without file comparison), or Quit? > [Q] e > 2011-03-22 04:06:06 failed to expand spool_directory > "/usr/globnix/homes/exim-build/exim/test/${lookup{spool}lsearch{/usr/globnix/homes/exim-build/exim/test/aux-fixed/0437.ls}}": > unknown lookup type "lsearch" > ----------------------------8< cut here >8------------------------------ > [ and again for command 2 ] > > ----------------------------8< cut here >8------------------------------ > Basic-ipv6/1003 interface selection (v4 vs v6) in outgoing SMTP > ** Comparison of test-mainlog-munged with log/1003 failed=============== > Lines 9-14 of "test-mainlog-munged" do not match lines 9-12 of "log/1003". > ---------- > 1999-03-02 09:44:33 10HmaZ-0005vi-00 ::1 [::1] Connection timed out > 1999-03-02 09:44:33 10HmaZ-0005vi-00 == userx [at] test R=client T=send_to_server defer (dd): Connection timed out > 1999-03-02 09:44:33 10HmbA-0005vi-00 => userx [at] test R=client T=send_to_server H=::1 [::1] > 1999-03-02 09:44:33 10HmbA-0005vi-00 Completed > 1999-03-02 09:44:33 10HmaZ-0005vi-00 => userx [at] test R=client T=send_to_server H=::1 [::1]* > 1999-03-02 09:44:33 10HmaZ-0005vi-00 Completed > ---------- > 1999-03-02 09:44:33 10HmaZ-0005vi-00 => userx [at] test R=client T=send_to_server H=::1 [::1] > 1999-03-02 09:44:33 10HmaZ-0005vi-00 Completed > 1999-03-02 09:44:33 10HmbA-0005vi-00 => userx [at] test R=client T=send_to_server H=::1 [::1] > 1999-03-02 09:44:33 10HmbA-0005vi-00 Completed > =============== > From line 23 of "test-mainlog-munged" and line 21 of "log/1003" the files are different. > ---------- > 1999-03-02 09:44:33 no host name found for IP address ::1 > 1999-03-02 09:44:33 10HmbD-0005vi-00 <= CALLER [at] myhost H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmbA-0005vi-00 [at] myhost > 1999-03-02 09:44:33 10HmbE-0005vi-00 <= CALLER [at] myhost H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmaZ-0005vi-00 [at] myhost > 1999-03-02 09:44:33 no host name found for IP address ::1 > 1999-03-02 09:44:33 10HmbF-0005vi-00 <= CALLER [at] myhost H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmbB-0005vi-00 [at] myhost > ---------- > 1999-03-02 09:44:33 10HmbD-0005vi-00 <= CALLER [at] myhost H=the.local.host.name (myhost.test.ex) [ip6:ip6:ip6:ip6:ip6:ip6:ip6:ip6] P=esmtp S=sss id=E10HmaZ-0005vi-00 [at] myhost > 1999-03-02 09:44:33 no host name found for IP address ::1 > 1999-03-02 09:44:33 10HmbE-0005vi-00 <= CALLER [at] myhost H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmbA-0005vi-00 [at] myhost > 1999-03-02 09:44:33 no host name found for IP address ::1 > 1999-03-02 09:44:33 10HmbF-0005vi-00 <= CALLER [at] myhost H=(myhost.test.ex) [::1] P=esmtp S=sss id=E10HmbB-0005vi-00 [at] myhost > =============== > 2 differences found. > "test-mainlog-munged" contains 27 lines; "log/1003" contains 25 lines. > ----------------------------8< cut here >8------------------------------ > > ----------------------------8< cut here >8------------------------------ > Basic-ipv6/1006 disable_ipv6 > ** Comparison of test-stdout-munged with stdout/1006 failed=============== > Line 8 of "test-stdout-munged" does not match line 8 of "stdout/1006". > ---------- > host 46.test.ex [V4NET.0.0.4] > ---------- > host 46.test.ex [V4NET.0.0.4] > =============== > 1 difference found. > "test-stdout-munged" contains 26 lines; "stdout/1006" contains 26 lines. > ----------------------------8< cut here >8------------------------------ > > Similar issue on: Basic-ipv6/1009 (line 4 instead of 8, but otherwise > the same). > > ----------------------------8< cut here >8------------------------------ > OpenSSL/2102 TLS server: general > ** Comparison of test-stdout-munged with stdout/2102 failed=============== > Line 29 of "test-stdout-munged" occurs before line 29 of "stdout/2102". > ---------- > SSL info: SSLv3 read server session ticket A > =============== > Lines 82-83 of "test-stdout-munged" do not match lines 81-82 of "stdout/2102". > ---------- > SSL info: SSLv3 read server session ticket A > SSL info: SSLv3 read server session ticket A > ---------- > SSL info: SSLv3 read finished A > SSL info: SSLv3 read finished A > =============== > Line 120 of "test-stdout-munged" occurs before line 119 of "stdout/2102". > ---------- > SSL info: SSLv3 read server session ticket A > =============== > 3 differences found. > "test-stdout-munged" contains 150 lines; "stdout/2102" contains 148 lines. > ----------------------------8< cut here >8------------------------------ > and similar for: OpenSSL/2114 OpenSSL/2124 > > ----------------------------8< cut here >8------------------------------ > OpenSSL/2103 TLS server: unavailable cipher > ** Comparison of test-stdout-munged with stdout/2103 failed=============== > Line 29 of "test-stdout-munged" occurs before line 29 of "stdout/2103". > ---------- > SSL info: SSLv3 read server session ticket A > =============== > Line 73 of "test-stdout-munged" occurs before line 72 of "stdout/2103". > ---------- > SSL info: SSLv3 read server session ticket A > =============== > 2 differences found. > "test-stdout-munged" contains 98 lines; "stdout/2103" contains 96 lines. > ----------------------------8< cut here >8------------------------------ > and similar for: OpenSSL/2105 OpenSSL/2106 OpenSSL/2118 OpenSSL/2119 > OpenSSL/2122 OpenSSL/2128 OpenSSL/2150 > plaintext-OpenSSL/3460 plaintext-OpenSSL/3463 > plaintext-OpenSSL/3464 > > ----------------------------8< cut here >8------------------------------ > Dovecot/3650 Dovecot authentication (server only) > ** runtest error: Couldn't open /usr/globnix/homes/exim-build/exim/test/confs/3650: No such file or directory > ----------------------------8< cut here >8------------------------------ > > After this one, runtest bailed out. Unsurprising, since there's a test > without a confs/ entry. > > Continued with { 4000 + }. > > ----------------------------8< cut here >8------------------------------ > maildir/5007 maildirsize for quota handling quota > 2G > ** Comparison of test-mail-munged with mail/5007.userx/new/1.myhost.test.ex failed=============== > From line 5 of "test-mail-munged" and line 5 of "mail/5007.userx/new/1.myhost.test.ex" the files are different. > ---------- > Message-Id: <E10HmaX-0005vi-00 [at] myhost> > From: CALLER_NAME <CALLER [at] test> > Date: Tue, 2 Mar 1999 09:44:33 +0000 > > Test message > ---------- > Date: Tue, 2 Mar 1999 09:44:33 +0000 > Message-Id: <E10HmaX-0005vi-00 [at] myhost> > From: CALLER_NAME <CALLER [at] test> > > Test message > =============== > 1 difference found. > "test-mail-munged" contains 9 lines; "mail/5007.userx/new/1.myhost.test.ex" contains 9 lines. > ----------------------------8< cut here >8------------------------------ > > -Phil > -- ## List details at http://lists.exim.org/mailman/listinfo/exim-dev Exim details at http://www.exim.org/ ##
|