Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Python: Bugs

[issue7361] Strange importlib error during test_multiprocessing failure

 

 

Python bugs RSS feed   Index | Next | Previous | View Threaded


report at bugs

Nov 19, 2009, 11:18 AM

Post #1 of 5 (229 views)
Permalink
[issue7361] Strange importlib error during test_multiprocessing failure

New submission from R. David Murray <rdmurray [at] bitdance>:

One of the buildbots suffered a test_multiprocessing failure, which
itself is not such an unusual thing. But the error that was
subsequently thrown looks like it might point to a place where
importlib's error handling could be improved. The error that was thrown
certainly gives no clear indication of what really caused the problem.

The full buildbot report was:
http://www.python.org/dev/buildbot/all/builders/ia64%20Ubuntu%203.1/builds/93/steps/test/logs/stdio

Here are the tracebacks (the second one being the interesting one):

Traceback (most recent call last):
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/multiprocessing/process.py",
line 233, in _bootstrap
self.run()
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/multiprocessing/process.py",
line 88, in run
self._target(*self._args, **self._kwargs)
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/test/test_multiprocessing.py",
line 1211, in _putter
queue = manager.get_queue()
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/multiprocessing/managers.py",
line 644, in temp
token, exp = self._create(typeid, *args, **kwds)
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/multiprocessing/managers.py",
line 544, in _create
id, exposed = dispatch(conn, None, 'create', (typeid,)+args, kwds)
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/multiprocessing/managers.py",
line 79, in dispatch
kind, result = c.recv()
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/multiprocessing/connection.py",
line 408, in recv
s = self._conn.recv_bytes()
IOError: [Errno 104] Connection reset by peer
test test_multiprocessing failed -- Traceback (most recent call last):
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/test/test_multiprocessing.py",
line 1222, in test_rapid_restart
queue = manager.get_queue()
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/multiprocessing/managers.py",
line 644, in temp
token, exp = self._create(typeid, *args, **kwds)
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/multiprocessing/managers.py",
line 542, in _create
conn = self._Client(self._address, authkey=self._authkey)
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/multiprocessing/connection.py",
line 427, in XmlClient
import xmlrpc.client as xmlrpclib
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/importlib/_bootstrap.py",
line 151, in decorated
return fxn(self, module)
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/importlib/_bootstrap.py",
line 399, in load_module
return self._load_module(module)
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/importlib/_bootstrap.py",
line 324, in _load_module
code_object = self.get_code(module.__name__)
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/importlib/_bootstrap.py",
line 411, in get_code
pyc_timestamp = marshal._r_long(data[4:8])
File
"/home/pybot/buildarea/3.1.klose-debian-ia64/build/Lib/importlib/__init__.py",
line 65, in _r_long
x = int_bytes[0]
IndexError: index out of range

----------
components: Library (Lib)
messages: 95511
nosy: brett.cannon, jnoller, r.david.murray
priority: low
severity: normal
stage: test needed
status: open
title: Strange importlib error during test_multiprocessing failure
type: behavior
versions: Python 3.1

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue7361>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com


report at bugs

Nov 19, 2009, 6:49 PM

Post #2 of 5 (195 views)
Permalink
[issue7361] Strange importlib error during test_multiprocessing failure [In reply to]

Brett Cannon <brett [at] python> added the comment:

I will obviously have a look, but why the heck is test_multiprocessing
calling importlib? Is it meant to do that? Or is this part of the -j flag
for regrtest?

----------
assignee: -> brett.cannon

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue7361>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com


report at bugs

Nov 19, 2009, 6:51 PM

Post #3 of 5 (199 views)
Permalink
[issue7361] Strange importlib error during test_multiprocessing failure [In reply to]

Brett Cannon <brett [at] python> added the comment:

And it looks like the error was triggered from a malformed .pyc file that
was truncated. Guess I need to be more careful with that possibility. =)

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue7361>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com


report at bugs

Nov 19, 2009, 7:08 PM

Post #4 of 5 (196 views)
Permalink
[issue7361] Strange importlib error during test_multiprocessing failure [In reply to]

R. David Murray <rdmurray [at] bitdance> added the comment:

This was on a buildbot, and regrtest -j isn't used there, but in any
case it wouldn't affect importlib as far as I know. From the traceback
it looks like multiprocessing is just doing an import.

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue7361>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com


report at bugs

Nov 20, 2009, 11:22 AM

Post #5 of 5 (184 views)
Permalink
[issue7361] Strange importlib error during test_multiprocessing failure [In reply to]

Brett Cannon <brett [at] python> added the comment:

Huh. I wonder how importlib is ending up being the implementation of
import then? Guess I also need to double-check everything is still
cleaning itself up properly.

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue7361>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

Python bugs RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.