Conversation
Contributor
There was a problem hiding this comment.
Automated Benchmark Update Review
This PR is a fully automated benchmark documentation update — all 19 changed files are confined to docs/docs/benchmarks/ and docs/static/benchmarks/, covering Markdown pages and JSON data files. There are no source code, engine, or test changes.
Assessment
The changes are straightforward and appropriate:
- Markdown files (
AsyncTests.md,BuildTime.md,DataDrivenTests.md, etc.) are refreshed with updated dates, timing numbers, and regenerated Mermaid charts. - JSON data files (
latest.json,historical.json,summary.json, and per-benchmark JSONs) are updated with the new run's measurements. - All changes are consistent with what an automated CI workflow ("Speed Comparison") would produce on a scheduled run (2026-03-16).
Notable Benchmark Observations
TUnit AOT performance remains exceptionally strong (e.g., AsyncTests AOT at ~123 ms vs. ~556 ms for JIT TUnit and ~780 ms for xUnit3), which continues to be a compelling differentiator.
Slight variations in JIT timings across all frameworks day-to-day are expected on shared CI runners and do not indicate regressions.
No Concerns
- No source code, public API, snapshot tests, or engine logic is touched.
- The automated PR workflow and merge process look correct.
- No
.received.txtfiles were committed (as required).
This is a clean, low-risk automated update. Nothing to change here.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Automated Benchmark Update
This PR updates the benchmark documentation with the latest results from the Speed Comparison workflow.
Benchmarks Produced
Individual benchmark artifacts are available for download:
benchmark-DataDrivenTestsbenchmark-AsyncTestsbenchmark-ScaleTestsbenchmark-MatrixTestsbenchmark-MassiveParallelTestsbenchmark-SetupTeardownTestsbenchmark-BuildTimebenchmark-summary(aggregated overview)Runtime Benchmarks
Build Benchmarks
Changes
docs/static/benchmarks/latest.jsondocs/static/benchmarks/historical.jsondocs/docs/benchmarks/index.mddocs/static/benchmarks/summary.jsonWorkflow Run
🤖 This PR was automatically created and will be merged automatically once CI checks pass.