Mailing List Archive: Python: Dev

bsddb: Test failures on windows (HELP!)

Index | Next | Previous | View Threaded

jcea at jcea

Jul 23, 2008, 8:33 AM

Post #1 of 7 (314 views)
Permalink

bsddb: Test failures on windows (HELP!)

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Trent, I was wondering if you could look at some test failures in MS
Windows builds. I can't debug Windows issues myself :-(. This is a MS
free environment...

Details:
<http://www.python.org/dev/buildbot/all/x86%20XP-4%20trunk/builds/1364/step-test/0>

Thanks in advance for your time and attention.

Of course, any other help appreciated :-)

- --
Jesus Cea Avion _/_/ _/_/_/ _/_/_/
jcea[at]jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/
jabber / xmpp:jcea[at]jabber.org _/_/ _/_/ _/_/_/_/_/
. _/_/ _/_/ _/_/ _/_/ _/_/
"Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/
"My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/
"El amor es poner tu felicidad en la felicidad de otro" - Leibniz
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iQCVAwUBSIdPJJlgi5GaxT1NAQLzFwP9E0huY63jOZWx9v/H7NhDGwIqFl5OGfhO
EZ6uCdRBuyH4Y4jQBaIKTFN9jXu2sSONNMBDgOZznkBuYtFIA8Xmn9KDrkuZ5k8G
1GlcG+DcoG1aP1PANgrPMkEpptw5/TNBlA3s6p/F4oDSye1kMW0CbGcSHeECYF9R
CIhZztqZvWk=
=aZoO
-----END PGP SIGNATURE-----
_______________________________________________
Python-Dev mailing list
Python-Dev[at]python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

mhammond at skippinet

Jul 23, 2008, 10:44 PM

Post #2 of 7 (289 views)
Permalink

Re: bsddb: Test failures on windows (HELP!) [In reply to]

> Trent, I was wondering if you could look at some test failures in MS
> Windows builds. I can't debug Windows issues myself :-(. This is a MS
> free environment...

In these errors I see lots of bsdbd errors, many of the form:

| DBFileExistsError: (17, 'File exists -- __fop_file_setup: Retry limit
(100) exceeded')

Maybe an old test file isn't being nuked? Others of the form:

| self.assertTrue(time.time()<timeout)
| AssertionError

which also look more related to the test suite than to Windows.

There are also lots of errors due to the environment having a unicode object
in it:

| test test_site failed -- Traceback (most recent call last):
| ...
| TypeError: environment can only contain strings

| test test_subprocess failed -- errors occurred; run in verbose mode for
details
| [Possibly the same error as below?]

| test test_sys failed -- Traceback (most recent call last):
| File "...\subprocess.py", line 817, in _execute_child
| startupinfo)
| TypeError: environment can only contain strings

* A couple of wsgi related errors, including one about the environment - but
this has more information:

AssertionError: "AssertionError: Environmental variable LIB is not a string:
<type 'unicode'> (value: u'C:\\\\Program Files\\\\Microsoft Visual Studio
9.0\\\\VC\\\\LIB;C:\\\\Program Files\\\\Microsoft
SDKs\\\\Windows\\\\v6.0A\\\\lib;c:\\\\program files\\\\microsoft visual
studio .NET 2003\\\\vc7\\\\atlmfc\\\\lib;c:\\\\program files\\\\microsoft
visual studio .NET 2003\\\\vc7\\\\lib;c:\\\\program files\\\\microsoft
visual studio .NET 2003\\\\vc7\\\\PlatformSDK\\\\lib;C:\\\\Program
Files\\\\Microsoft Visual Studio .NET 2003\\\\SDK\\\\v1.1\\\\Lib\\\\')" !=
"AssertionError: Headers (('Content-Type', 'text/plain')) must be of type
list: <type 'tuple'>"

So LIB has a Unicode value - evn though it has no Unicode characters, and
was presumably in the environment Python inherited (but presumably was
initially a string).

I can't reproduce the Unicode errors: 'python test_sys.py' works and I
couldn't run a full test suite (see below). Python allows you to set
unicode objects in os.environ, so its possible part of the test suite is
modifying the environment.

I tried to run a full test, but it hangs in various places before test_sys
(bz2, multiprocessing), and I ended up giving up. This was on for either 32
or 64bits with the current trunk, but sadly I've no idea what could be
happening there :(

So it sounds like just tracking down how a unicode object is getting into
the environment will solve the vast majority of the errors - except for the
bsddb and wsgi ones, which don't look particularly Windows specific...

Hope that helps a bit...

Mark

_______________________________________________
Python-Dev mailing list
Python-Dev[at]python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

tseaver at palladion

Jul 24, 2008, 5:39 AM

Post #3 of 7 (287 views)
Permalink

Re: bsddb: Test failures on windows (HELP!) [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Mark Hammond wrote:

>> Trent, I was wondering if you could look at some test failures in MS
>> Windows builds. I can't debug Windows issues myself :-(. This is a MS
>> free environment...
>
> In these errors I see lots of bsdbd errors, many of the form:
>
> | DBFileExistsError: (17, 'File exists -- __fop_file_setup: Retry limit
> (100) exceeded')

Maybe this one is due to the fact that Windows, unlike POSIX, doesn't
allow unlinking an open file?

> Maybe an old test file isn't being nuked? Others of the form:
>
> | self.assertTrue(time.time()<timeout)
> | AssertionError
>
> which also look more related to the test suite than to Windows.

Perhaps this is due to differing timer granularity on Windows?

> There are also lots of errors due to the environment having a unicode object
> in it:
>
> | test test_site failed -- Traceback (most recent call last):
> | ...
> | TypeError: environment can only contain strings
>
> | test test_subprocess failed -- errors occurred; run in verbose mode for
> details
> | [Possibly the same error as below?]
>
> | test test_sys failed -- Traceback (most recent call last):
> | File "...\subprocess.py", line 817, in _execute_child
> | startupinfo)
> | TypeError: environment can only contain strings

That definitely shouldn't happen on Unix either.

Tres.
- --
===================================================================
Tres Seaver +1 540-429-0999 tseaver[at]palladion.com
Palladion Software "Excellence by Design" http://palladion.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFIiHfr+gerLs4ltQ4RAk5KAJ9It0Am1VfFNQNaE+wA8uWkkTZ6wQCgtwlx
o16eVKpEXTHED4X1/Vi0Nk0=
=zzKd
-----END PGP SIGNATURE-----

_______________________________________________
Python-Dev mailing list
Python-Dev[at]python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

amauryfa at gmail

Jul 24, 2008, 7:23 AM

Post #4 of 7 (290 views)
Permalink

Re: bsddb: Test failures on windows (HELP!) [In reply to]

Tres Seaver wrote:
> Mark Hammond wrote:
>
>>> Trent, I was wondering if you could look at some test failures in MS
>>> Windows builds. I can't debug Windows issues myself :-(. This is a MS
>>> free environment...
>>
>> In these errors I see lots of bsdbd errors, many of the form:
>>
>> | DBFileExistsError: (17, 'File exists -- __fop_file_setup: Retry limit
>> (100) exceeded')
>
> Maybe this one is due to the fact that Windows, unlike POSIX, doesn't
> allow unlinking an open file?

I see that some tests use os.unlink. They should use
test_support.unlink() instead.

--
Amaury Forgeot d'Arc
_______________________________________________
Python-Dev mailing list
Python-Dev[at]python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

jcea at jcea

Jul 24, 2008, 9:03 AM

Post #5 of 7 (285 views)
Permalink

Re: bsddb: Test failures on windows (HELP!) [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Jesus Cea wrote:
| Trent, I was wondering if you could look at some test failures in MS
| Windows builds. I can't debug Windows issues myself :-(. This is a MS
| free environment...

I will be out of the city, 100% offline, until monday/tuesday. I will
read your suggestions and do some tests as soon as possible. Please,
keep the brainstorming going :)

Feel free to (minimally };-)) touch the testcases trying to improve the
situation. If that does the trick, please let me know to integrate the
changes in my code. Remember this code must work in python 2.[3-6]
(reason, for example, because I have my own "test_support" code, in
pybsddb).

Thanks a lot for your invaluable suggestions.

- --
Jesus Cea Avion _/_/ _/_/_/ _/_/_/
jcea[at]jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/
jabber / xmpp:jcea[at]jabber.org _/_/ _/_/ _/_/_/_/_/
. _/_/ _/_/ _/_/ _/_/ _/_/
"Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/
"My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/
"El amor es poner tu felicidad en la felicidad de otro" - Leibniz
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iQCVAwUBSIinuplgi5GaxT1NAQK6qQP+LOv1lU6G6+GaSrxUqrnFM62bTcmXCMay
S0ic3rWYUL4YTvWT/Ips/qBgYvRCPl3uHnmIDia9UAOnYh3EYjkFN+/4GDofGwM+
1UBRu86C7LsYdJl2VlHJyHGWmz6tgbbtAue306CNX01yD+pwYsCUqMSTuzjiiNCx
/q1DHdJv8Qo=
=OpNx
-----END PGP SIGNATURE-----
_______________________________________________
Python-Dev mailing list
Python-Dev[at]python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

jcea at jcea

Jul 29, 2008, 6:51 AM

Post #6 of 7 (256 views)
Permalink

Re: bsddb: Test failures on windows (HELP!) [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Amaury Forgeot d'Arc wrote:
| I see that some tests use os.unlink. They should use
| test_support.unlink() instead.

Old stuff. Fix just committed.

- --
Jesus Cea Avion _/_/ _/_/_/ _/_/_/
jcea[at]jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/
jabber / xmpp:jcea[at]jabber.org _/_/ _/_/ _/_/_/_/_/
. _/_/ _/_/ _/_/ _/_/ _/_/
"Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/
"My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/
"El amor es poner tu felicidad en la felicidad de otro" - Leibniz
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iQCVAwUBSI8gQ5lgi5GaxT1NAQJyHwQAiU6izAcI5eI3tizxWkvsw4MBRmQzlGNi
Ib+U/ZxuO9bqYOXZLqIQWkH2Ry1/Li7KeepVRehdkVlSnFEkWVXPhNofxvlXoQpl
Rt0T8aGJ1GhWkdojkWE7Ab2L8mdTCunHuVyiAQBagTET1E9iRnjrf5//XsRvd09Z
SUfPgEnvqv4=
=96Vt
-----END PGP SIGNATURE-----
_______________________________________________
Python-Dev mailing list
Python-Dev[at]python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

guido at python

Jul 29, 2008, 5:30 PM

Post #7 of 7 (253 views)
Permalink

Re: bsddb: Test failures on windows (HELP!) [In reply to]

On Wed, Jul 23, 2008 at 10:44 PM, Mark Hammond
<mhammond[at]skippinet.com.au> wrote:
>> Trent, I was wondering if you could look at some test failures in MS
>> Windows builds. I can't debug Windows issues myself :-(. This is a MS
>> free environment...
>
> In these errors I see lots of bsdbd errors, many of the form:
>
> | DBFileExistsError: (17, 'File exists -- __fop_file_setup: Retry limit
> (100) exceeded')

I've had this a few times in the past (Retry limit (100) exceeded)and
it has always been caused by cruft left behind by a previous run of
the test that didn't end well. Somehow these tests do not do a good
job of cleaning up old cruft before they run.

--
--Guido van Rossum (home page: http://www.python.org/~guido/)
_______________________________________________
Python-Dev mailing list
Python-Dev[at]python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact lists@gossamer-threads.com