Visitar URL original
GH-84559: Deprecate fork being the multiprocessing default. by gpshead · Pull Request #100618 · python/cpython · GitHub
Skip to content

GH-84559: Deprecate fork being the multiprocessing default. #100618

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
gpshead merged 23 commits into from
Feb 2, 2023
Merged

GH-84559: Deprecate fork being the multiprocessing default. #100618

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
1cecbdb
GH-84559: Deprecate fork being the multiprocessing default.
gpshead Dec 30, 2022
df83fba
address CI test failures?
gpshead Dec 31, 2022
ec1e868
the new warning needs no pickle name mapping
gpshead Dec 31, 2022
a1064de
avoid DeprecationWarnings vs -Werror
gpshead Dec 31, 2022
223b748
prefer forkserver over fork for concurrent.futures
gpshead Dec 31, 2022
fc64626
explicitly use spawn for simple process launchers.
gpshead Dec 31, 2022
e45fab6
warn from concurrent.futures, reword things.
gpshead Dec 31, 2022
29764a2
avoid double warning in futures
gpshead Dec 31, 2022
c52b9db
Cleanup messages, test futures warning.
gpshead Dec 31, 2022
4c8cc34
cleanup warn stacklevel logic
gpshead Dec 31, 2022
7179684
Document all the things!
gpshead Dec 31, 2022
f7e3161
Have all doctests use 'spawn'.
gpshead Jan 1, 2023
9947860
Correct warning stacklevel for Manager.
gpshead Jan 1, 2023
5834f2d
more doctest cleanup.
gpshead Jan 1, 2023
7d48e86
NEWS entry.
gpshead Jan 1, 2023
28c0cfc
docs: add the implicit i
gpshead Jan 10, 2023
2820bb8
Merge branch 'main' into multiprocessing/deprecate-fork-default
gpshead Jan 28, 2023
4c16205
Use skip_file_prefixes.
gpshead Jan 28, 2023
7d84a72
use the modern warnings API, doc updates.
gpshead Jan 28, 2023
8b2029e
documentation cleanup
gpshead Jan 28, 2023
846e9a0
Remove an unused variable.
gpshead Feb 1, 2023
7078986
doc typo fix, unnecessary method change revert.
gpshead Feb 1, 2023
e3e3b3c
Add What's New entries.
gpshead Feb 2, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Correct warning stacklevel for Manager.
  • Loading branch information
@gpshead
gpshead committed Jan 1, 2023
commit 99478600da7d30c8dc30b6df6a9533602a762eba
9 changes: 8 additions & 1 deletion Lib/multiprocessing/context.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -56,8 +56,15 @@ def Manager(self):
can be used to create shared objects.
'''
from .managers import SyncManager
m = SyncManager(ctx=self.get_context())
ctx = self.get_context()
m = SyncManager(ctx=ctx)
proc_class = ctx.Process
Comment thread
gpshead marked this conversation as resolved.
Outdated
orig_level = getattr(proc_class, '_ORIG_WARNING_STACKLEVEL', None)
if orig_level:
ctx.Process._warning_stacklevel = 6 # blame mp.Manager()
m.start()
if orig_level:
ctx.Process._warning_stacklevel = orig_level
return m

def Pipe(self, duplex=True):
Expand Down
13 changes: 13 additions & 0 deletions Lib/test/test_multiprocessing_defaults.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -54,6 +54,19 @@ def test_default_fork_start_method_warning_pool(self):
self.assertIn("get_context", str(ws[0].message))
self.assertEqual(len(ws), 1, msg=[str(x) for x in ws])

def test_default_fork_start_method_warning_manager(self):
with warnings.catch_warnings(record=True) as ws:
warnings.simplefilter('ignore')
warnings.filterwarnings('always', category=DefaultForkDeprecationWarning)
manager = multiprocessing.Manager() # warning should point here.
manager.shutdown()
self.assertIsInstance(ws[0].message, DefaultForkDeprecationWarning)
self.assertIn(__file__, ws[0].filename)
self.assertEqual(getframeinfo(currentframe()).lineno-4, ws[0].lineno)
self.assertIn("'fork'", str(ws[0].message))
self.assertIn("get_context", str(ws[0].message))
self.assertEqual(len(ws), 1, msg=[str(x) for x in ws])

def test_no_mp_warning_when_using_explicit_fork_context(self):
with warnings.catch_warnings(record=True) as ws:
warnings.simplefilter('ignore')
Expand Down