replace raw copy threads with a persistent copy_executor_ - #6079

Open

FriedCosey wants to merge 7 commits into

pytorch:mainfrom

FriedCosey:export-D113752426

Commits on Jul 27, 2026

Chunk the D2H copy across N copy threads (#6068)

Joey Yang
authored and
facebook-github-bot
committed
a928b7b
Drain the stream queue across N consumer threads (#6069)

Joey Yang
authored and
facebook-github-bot
committed
e7f361f
Make RES chunk size + ship/copy thread counts config-tunable (#6075)

Joey Yang
authored and
facebook-github-bot
committed
1e6e42b
Un-nest tensor_copy_chunk dispatch lambdas (#6074)

Joey Yang
authored and
facebook-github-bot
committed
86481a4
Replace raw dispatcher thread with a named CPUThreadPoolExecutor

Joey Yang
authored and
facebook-github-bot
committed
4589700
Replace raw consumer threads + polled queue with a push executor (#6076)

Joey Yang
authored and
facebook-github-bot
committed
abae9b8
replace raw copy threads with a persistent copy_executor_

Joey Yang
authored and
facebook-github-bot
committed
91f32ee