Skip to content

Simplify benchmark deployments and improve result reporting - #48

Merged
gabotechs merged 1 commit into
mainfrom
codex/simplify-benchmark-deployment-reporting
Aug 13, 2026
Merged

Simplify benchmark deployments and improve result reporting#48
gabotechs merged 1 commit into
mainfrom
codex/simplify-benchmark-deployment-reporting

Conversation

@gabotechs

Copy link
Copy Markdown
Owner

Summary

  • remove the runtime-file handoff and capture published engine artifacts directly from standard command output
  • make benchmark iteration and warmup settings explicit
  • improve result comments with exact base/head commit links, a source comparison link, and expandable verification and timing details

Why

The runtime metadata file added unnecessary state and a second handoff mechanism to deployments. Engine publishing and deployment can instead behave like normal shell commands: publishers return their artifact identifiers directly to the caller.

Benchmark comments also need enough immutable source and execution detail for reviewers to verify what was actually tested.

Validation

@gabotechs
gabotechs merged commit 473bcb1 into main Aug 13, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant