Staging
v0.5.1
v0.5.1
https://github.com/python/cpython
Revision a5cbab552d294d99fde864306632d7e511a75d3c authored by Thomas Moreau on 16 February 2020, 18:09:26 UTC, committed by GitHub on 16 February 2020, 18:09:26 UTC
As reported initially by @rad-pat in #6084, the following script causes a deadlock.
```
from concurrent.futures import ProcessPoolExecutor
class ObjectWithPickleError():
"""Triggers a RuntimeError when sending job to the workers"""
def __reduce__(self):
raise RuntimeError()
if __name__ == "__main__":
e = ProcessPoolExecutor()
f = e.submit(id, ObjectWithPickleError())
e.shutdown(wait=False)
f.result() # Deadlock on get
```
This is caused by the fact that the main process is closing communication channels that might be necessary to the `queue_management_thread` later. To avoid this, this PR let the `queue_management_thread` manage all the closing.
https://bugs.python.org/issue39104
Automerge-Triggered-By: @pitrou 1 parent 1ed6161
Tip revision: a5cbab552d294d99fde864306632d7e511a75d3c authored by Thomas Moreau on 16 February 2020, 18:09:26 UTC
bpo-39104: Fix hanging ProcessPoolExecutor on shutdown nowait with pickling failure (GH-17670)
bpo-39104: Fix hanging ProcessPoolExecutor on shutdown nowait with pickling failure (GH-17670)
Tip revision: a5cbab5
| File | Mode | Size |
|---|---|---|
| cpython | ||
| internal | ||
| Python-ast.h | -rw-r--r-- | 25.9 KB |
| Python.h | -rw-r--r-- | 3.5 KB |
| abstract.h | -rw-r--r-- | 29.8 KB |
| asdl.h | -rw-r--r-- | 1.2 KB |
| ast.h | -rw-r--r-- | 947 bytes |
| bitset.h | -rw-r--r-- | 468 bytes |
| bltinmodule.h | -rw-r--r-- | 264 bytes |
| boolobject.h | -rw-r--r-- | 885 bytes |
| bytearrayobject.h | -rw-r--r-- | 1.4 KB |
| bytesobject.h | -rw-r--r-- | 3.0 KB |
| cellobject.h | -rw-r--r-- | 712 bytes |
| ceval.h | -rw-r--r-- | 5.7 KB |
| classobject.h | -rw-r--r-- | 1.6 KB |
| code.h | -rw-r--r-- | 6.8 KB |
| codecs.h | -rw-r--r-- | 6.6 KB |
| compile.h | -rw-r--r-- | 3.2 KB |
| complexobject.h | -rw-r--r-- | 1.8 KB |
| context.h | -rw-r--r-- | 2.0 KB |
| datetime.h | -rw-r--r-- | 9.0 KB |
| descrobject.h | -rw-r--r-- | 2.9 KB |
| dictobject.h | -rw-r--r-- | 3.6 KB |
| dynamic_annotations.h | -rw-r--r-- | 21.9 KB |
| enumobject.h | -rw-r--r-- | 253 bytes |
| errcode.h | -rw-r--r-- | 1.7 KB |
| eval.h | -rw-r--r-- | 1.2 KB |
| exports.h | -rw-r--r-- | 1.1 KB |
| fileobject.h | -rw-r--r-- | 1.3 KB |
| fileutils.h | -rw-r--r-- | 597 bytes |
| floatobject.h | -rw-r--r-- | 4.3 KB |
| frameobject.h | -rw-r--r-- | 433 bytes |
| funcobject.h | -rw-r--r-- | 4.0 KB |
| genobject.h | -rw-r--r-- | 3.5 KB |
| graminit.h | -rw-r--r-- | 2.1 KB |
| grammar.h | -rw-r--r-- | 1.8 KB |
| import.h | -rw-r--r-- | 3.0 KB |
| interpreteridobject.h | -rw-r--r-- | 334 bytes |
| intrcheck.h | -rw-r--r-- | 861 bytes |
| iterobject.h | -rw-r--r-- | 521 bytes |
| listobject.h | -rw-r--r-- | 1.7 KB |
| longintrepr.h | -rw-r--r-- | 3.7 KB |
| longobject.h | -rw-r--r-- | 9.3 KB |
| marshal.h | -rw-r--r-- | 803 bytes |
| memoryobject.h | -rw-r--r-- | 2.7 KB |
| methodobject.h | -rw-r--r-- | 3.6 KB |
| modsupport.h | -rw-r--r-- | 9.4 KB |
| moduleobject.h | -rw-r--r-- | 2.3 KB |
| namespaceobject.h | -rw-r--r-- | 349 bytes |
| node.h | -rw-r--r-- | 1.3 KB |
| object.h | -rw-r--r-- | 23.6 KB |
| objimpl.h | -rw-r--r-- | 9.8 KB |
| odictobject.h | -rw-r--r-- | 1.3 KB |
| opcode.h | -rw-r--r-- | 4.8 KB |
| osdefs.h | -rw-r--r-- | 737 bytes |
| osmodule.h | -rw-r--r-- | 291 bytes |
| parsetok.h | -rw-r--r-- | 2.9 KB |
| patchlevel.h | -rw-r--r-- | 1.3 KB |
| picklebufobject.h | -rw-r--r-- | 846 bytes |
| py_curses.h | -rw-r--r-- | 2.4 KB |
| pyarena.h | -rw-r--r-- | 2.7 KB |
| pycapsule.h | -rw-r--r-- | 1.7 KB |
| pyctype.h | -rw-r--r-- | 1.3 KB |
| pydebug.h | -rw-r--r-- | 1.2 KB |
| pydtrace.d | -rw-r--r-- | 1008 bytes |
| pydtrace.h | -rw-r--r-- | 2.4 KB |
| pyerrors.h | -rw-r--r-- | 12.5 KB |
| pyexpat.h | -rw-r--r-- | 2.4 KB |
| pyfpe.h | -rw-r--r-- | 444 bytes |
| pyhash.h | -rw-r--r-- | 4.0 KB |
| pylifecycle.h | -rw-r--r-- | 2.0 KB |
| pymacconfig.h | -rw-r--r-- | 2.9 KB |
| pymacro.h | -rw-r--r-- | 4.5 KB |
| pymath.h | -rw-r--r-- | 8.4 KB |
| pymem.h | -rw-r--r-- | 4.3 KB |
| pyport.h | -rw-r--r-- | 29.3 KB |
| pystate.h | -rw-r--r-- | 4.5 KB |
| pystrcmp.h | -rw-r--r-- | 436 bytes |
| pystrhex.h | -rw-r--r-- | 849 bytes |
| pystrtod.h | -rw-r--r-- | 1.4 KB |
| pythonrun.h | -rw-r--r-- | 7.5 KB |
| pythread.h | -rw-r--r-- | 5.5 KB |
| pytime.h | -rw-r--r-- | 8.7 KB |
| rangeobject.h | -rw-r--r-- | 628 bytes |
| setobject.h | -rw-r--r-- | 3.3 KB |
| sliceobject.h | -rw-r--r-- | 2.5 KB |
| structmember.h | -rw-r--r-- | 2.0 KB |
| structseq.h | -rw-r--r-- | 1.4 KB |
| symtable.h | -rw-r--r-- | 5.2 KB |
| sysmodule.h | -rw-r--r-- | 1.2 KB |
| token.h | -rw-r--r-- | 2.4 KB |
| traceback.h | -rw-r--r-- | 600 bytes |
| tracemalloc.h | -rw-r--r-- | 1.1 KB |
| tupleobject.h | -rw-r--r-- | 1.6 KB |
| typeslots.h | -rw-r--r-- | 2.2 KB |
| ucnhash.h | -rw-r--r-- | 1.0 KB |
| unicodeobject.h | -rw-r--r-- | 34.6 KB |
| warnings.h | -rw-r--r-- | 1.7 KB |
| weakrefobject.h | -rw-r--r-- | 2.8 KB |
Computing file changes ...
