Skip to content

Migrate benchmark workflow from BenchmarkCI to AirspeedVelocity#7

Merged
Krastanov merged 1 commit into
QuantumSavory:masterfrom
Krastanov-agent:migrate-benchmark-to-airspeedvelocity
Feb 20, 2026
Merged

Migrate benchmark workflow from BenchmarkCI to AirspeedVelocity#7
Krastanov merged 1 commit into
QuantumSavory:masterfrom
Krastanov-agent:migrate-benchmark-to-airspeedvelocity

Conversation

@Krastanov-agent
Copy link
Copy Markdown

Summary

Migrates the benchmark workflow from manual BenchmarkCI implementation to the modern AirspeedVelocity action.

Changes

  • Replaces 50+ line manual workflow with 3-line action
  • Uses MilesCranmer/AirspeedVelocity.jl@action-v1
  • Maintains same functionality: benchmark PRs and post results as comments

Benefits

Much simpler - Reduces workflow from 50+ lines to just 3 lines
Easier to maintain - No manual artifact handling or complex scripts
Consistent - Matches other repos in the organization
Modern - Uses the recommended Julia benchmarking action
Same functionality - Automatic PR comments with benchmark comparisons

Migration Details

Before (BenchmarkCI):

  • Manual setup of Julia, dependencies, and BenchmarkCI
  • Custom scripts to run benchmarks and format output
  • Manual artifact upload/download
  • Requires maintenance of custom workflow logic

After (AirspeedVelocity):

- uses: MilesCranmer/AirspeedVelocity.jl@action-v1
  with:
    julia-version: '1'
    tune: 'false'

The action handles everything automatically:

  • Checks out both base and PR branches
  • Runs benchmark suite on both
  • Compares results
  • Posts formatted comment to PR

Test Plan

  • Verify benchmark.yml has been replaced with AirspeedVelocity action
  • Create a test PR to verify benchmarks run correctly
  • Confirm benchmark results are posted as PR comments

Reference

🤖 Generated with Claude Code

Replaces the manual BenchmarkCI workflow (50+ lines) with the modern
AirspeedVelocity action (3 lines).

Changes:
- Replaced benchmark.yml with AirspeedVelocity action
- Deleted benchmark-comment.yml (no longer needed)

Benefits:
- Much simpler and easier to maintain
- Consistent with other repos in the organization
- Automatic PR comments with benchmark results
- Better integration with GitHub Actions

The AirspeedVelocity action handles all the complexity internally:
- Running benchmarks on base and PR branches
- Comparing results and generating reports
- Posting formatted comments to PRs

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
@Krastanov-agent Krastanov-agent force-pushed the migrate-benchmark-to-airspeedvelocity branch from 12ac9a0 to e08215f Compare February 20, 2026 20:37
@Krastanov Krastanov merged commit 2e17eef into QuantumSavory:master Feb 20, 2026
1 of 10 checks passed
@codecov
Copy link
Copy Markdown

codecov Bot commented Feb 20, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 100.00%. Comparing base (8e8cda3) to head (e08215f).
⚠️ Report is 2 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff            @@
##            master        #7   +/-   ##
=========================================
  Coverage   100.00%   100.00%           
=========================================
  Files            1         1           
  Lines            7         7           
=========================================
  Hits             7         7           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants