Skip to content

feat: add Qwen3-VL ViT frame parallel SP support#177

Merged
kcz358 merged 2 commits into
mainfrom
qwen3-vl-vit-frame-parallel-sp
May 21, 2026
Merged

feat: add Qwen3-VL ViT frame parallel SP support#177
kcz358 merged 2 commits into
mainfrom
qwen3-vl-vit-frame-parallel-sp

Conversation

@kcz358
Copy link
Copy Markdown
Collaborator

@kcz358 kcz358 commented May 21, 2026

Summary

  • Add Qwen3-VL ViT frame-parallel monkey patch and dispatch, including deepstack feature routing.
  • Add a Qwen3-VL ViT frame parallel + Ulysses SP example config and launcher.
  • Prefer local-aware ViT frame balancing by spilling frames only from overloaded ranks.

Test Plan

  • User tested training path externally.
  • Static checks run locally: python -m py_compile on changed Python files and git diff --check.

@kcz358 kcz358 merged commit 5bc0b35 into main May 21, 2026
3 checks passed
@kcz358 kcz358 deleted the qwen3-vl-vit-frame-parallel-sp branch May 21, 2026 05:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant