Skip to content

[Draft] FEAT: extend profiling to child processes #431

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
TTsangSC wants to merge 56 commits into
base: main
Choose a base branch
from
Open

[Draft] FEAT: extend profiling to child processes #431

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
56 commits
Select commit Hold shift + click to select a range
6a6d1fd
Moved kernprof pre-import code to another module
TTsangSC Mar 25, 2026
f2c8565
Removed redundant check in kernprof
TTsangSC Mar 25, 2026
fa817a7
Move code between kernprof & `~.curated_profiling`
TTsangSC Mar 26, 2026
1af7db5
New subpackage for profiling child processes
TTsangSC Mar 28, 2026
4bf52a5
WIP: set up child-proc profiling via import sys
TTsangSC Mar 28, 2026
0869ab4
WIP: `multiprocessing` patches
TTsangSC Mar 28, 2026
e56d23b
Child-process stat gathering; cache refactoring
TTsangSC Mar 28, 2026
6f43316
WIP: kernprof now sets up child-proc profiling
TTsangSC Mar 29, 2026
4e8ea92
Debugging support in `kernprof`
TTsangSC Apr 1, 2026
5d89868
Cleanup prioritization and more debug messages
TTsangSC Apr 6, 2026
e6faa2a
Try to keep one cache per process
TTsangSC Apr 7, 2026
4d6900a
Renamed submodule
TTsangSC Apr 7, 2026
1bd36ed
WIP: pass along more data
TTsangSC Apr 7, 2026
c26f9ef
WIP: fix profiling for forked processes
TTsangSC Apr 8, 2026
74d310f
Cleanup: `[...].multiprocessing_patches`
TTsangSC Apr 8, 2026
21ec218
Removed `import_machinery`
TTsangSC Apr 8, 2026
a51411f
Fixed stat-aggregation bug
TTsangSC Apr 8, 2026
c06eea6
More forked-process fixes
TTsangSC Apr 8, 2026
ab8b6a0
Streamlined debug output in `_child_process_profiling`
TTsangSC Apr 8, 2026
5391838
WIP: refactoring `tests/test_child_procs.py`
TTsangSC Apr 9, 2026
3288fdf
Test local funcs in the profiled script
TTsangSC Apr 9, 2026
7034479
Consolidated tests
TTsangSC Apr 9, 2026
4f107bf
Added tests for our `multiprocessing` patches
TTsangSC Apr 11, 2026
e13f537
WIP: flesh out the child-proc tests more
TTsangSC Apr 12, 2026
f5d03c4
WIP: test when the parallelly-run func fails
TTsangSC Apr 12, 2026
d12b26e
More debug output, flexible `multiprocessing` patching
TTsangSC Apr 13, 2026
3529759
Fix attribute-cleanup logic in `multiprocessing_patches.apply()`
TTsangSC Apr 13, 2026
4ea789a
WIP: let child processes fully clean up before terminating them
TTsangSC Apr 13, 2026
db3090c
Clean up `~~.multiprocessing_patches`
TTsangSC Apr 13, 2026
67868aa
Fix `tests/test_child_procs.py`
TTsangSC Apr 13, 2026
cc980e1
Test for non-`multiprocessing` child processes
TTsangSC Apr 13, 2026
9070426
Unify tempfile creation
TTsangSC Apr 14, 2026
1197fb9
Failsafe: timeout the lock-file waiting
TTsangSC Apr 14, 2026
c0b93a8
Added check in tests for .pth-file cleanup
TTsangSC Apr 14, 2026
0aabec4
Fix kernprof docstring
TTsangSC Apr 14, 2026
1b1fe3e
Shuffled code inside `~._child_process_profiling`
TTsangSC Apr 14, 2026
8361ee6
Fix `subprocess.run()` wrapper in tests
TTsangSC Apr 14, 2026
08d0b05
CHANGELOG and help-text update
TTsangSC Apr 14, 2026
ff42d21
Typing fixes
TTsangSC Apr 15, 2026
102f8eb
Cache refactoring + logging improvement
TTsangSC Apr 16, 2026
234dbe5
Factor out common utils
TTsangSC Apr 16, 2026
908780d
Refactored `LineProfilingCache` logging
TTsangSC Apr 16, 2026
aca4e2c
WIP: write combined debug logs for debugging
TTsangSC Apr 16, 2026
25e11f9
Compatibility fix
TTsangSC Apr 16, 2026
48cc7d1
Compat fix (test)
TTsangSC Apr 16, 2026
4630938
Better handling of `multiprocessing`
TTsangSC Apr 17, 2026
8ccba54
Cache the active config
TTsangSC Apr 18, 2026
0402369
Move config for `multiprocessing_patches`
TTsangSC Apr 18, 2026
eb5deb6
Streamlined profiler installation
TTsangSC Apr 18, 2026
6057c4a
WIP: boost test coverage
TTsangSC Apr 18, 2026
a59bfd0
Minor refactoring
TTsangSC Apr 18, 2026
4683c05
More in-process unit tests for `test_child_procs`
TTsangSC Apr 18, 2026
8e9cd0a
WIP debug the new unit tests
TTsangSC Apr 19, 2026
7fc09e9
Restart the fork-server process after each session
TTsangSC Apr 20, 2026
11893a1
Simplify `multiprocessing_patches`
TTsangSC Apr 20, 2026
34adbab
iMisc. test fixes
TTsangSC Apr 20, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions CHANGELOG.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@ Changes
is available (#427)
* FIX: Bytecodes of profiled functions now always labeled to prevent
confusion with non-profiled "twins" (#425)
* FEAT: Experimental support for profiling child processes with
``kernprof --prof-child-procs`` (#431)


5.0.2
Expand Down
Loading
Loading