Skip to content

Report benchmark task counts - #49

Merged
gabotechs merged 1 commit into
mainfrom
codex/report-benchmark-task-counts
Aug 14, 2026
Merged

Report benchmark task counts#49
gabotechs merged 1 commit into
mainfrom
codex/report-benchmark-task-counts

Conversation

@gabotechs

Copy link
Copy Markdown
Owner

Summary

  • report average worker-task counts alongside each query comparison
  • report the sum of per-query task averages in each dataset summary
  • keep task totals visible in the benchmark bot's collapsed result view
  • add a small shell utility for summing measured tasks in a stored result directory

Why

Benchmark result JSON already records the distributed worker-task count for every measured iteration, but comparisons only exposed elapsed time. Reporting both values makes parallelism changes directly visible and easier to correlate with performance.

Validation

  • npm run build
  • npm test (103 tests)
  • bash -n benchmarks-remote/sum-tasks.sh
  • ran sum-tasks.sh against an existing TPCH/SF1 result directory and recovered 920 measured tasks
  • git diff --check

@gabotechs
gabotechs merged commit 31bdfa7 into main Aug 14, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant