ci(mesh): add Atomesh accuracy and benchmark workflows#1159
Merged
Conversation
cbac91e to
f19a129
Compare
- Validate standalone-mode accuracy via Atomesh entrypoints. - Mocker benchmark to PD routing scenarios with topology and consumer concurrency matrix.
- Add a custom dashboard for Atomesh mocker benchmark results. - Show throughput, latency, detailed performance data, commit links, and CI run links. - Align the benchmark matrix with 1P1D, 2P1D, and 3P1D topologies across consumer concurrency levels.
…/feat-mesh-ci pushes.
…at-mesh-ci pushes.'
f19a129 to
b8cd277
Compare
valarLip
approved these changes
Jun 15, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Motivation
This PR adds dedicated Atomesh CI coverage for mesh correctness, mocker-based PD routing performance, and dashboard visibility.
Atomesh has different validation needs from the full ATOM model CI. The goal is to keep mesh CI focused, lightweight, and actionable:
Summary
Atomesh accuracy validation
USE_ATOMESH_ENTRYPOINTS=1.models_accuracy.jsonownership remains unchanged.pr:Meta-Llama-3-8B-Instructmain:DeepSeek-R1-0528nightly:DeepSeek-V4-Pro MTP,gpt-oss-120bprmodels for fast entrypoint validation.mainrunspr + mainmodels.pr + main + nightlymodels.This keeps Atomesh standalone validation focused on
USE_ATOMESH_ENTRYPOINTS=1integration coverage, while the full ATOM accuracy workflows continue to own the complete model matrix.Atomesh mocker benchmark
1P1D2P1D3P1D1, 2, 4, 8, 16Mocker benchmark dashboard
Live: https://rocm.github.io/ATOM/atomesh-mocker-dashboard/
Performance,Accuracy, andTrendsviews.gh-pages.CI routing optimization
ATOM TestATOM vLLM TestATOM SGLang Test