Add GitHub Actions CI pilot (with Codecov) alongside Azure Pipelines#2905
Open
nohwnd wants to merge 4 commits into
Open
Add GitHub Actions CI pilot (with Codecov) alongside Azure Pipelines#2905nohwnd wants to merge 4 commits into
nohwnd wants to merge 4 commits into
Conversation
nohwnd
force-pushed
the
ci/gh-actions-pilot
branch
from
July 18, 2026 10:05
2e2a602 to
64e2f1b
Compare
Runs in parallel with azure-pipelines.yml so we can compare the two before cutting over. Build once on Windows, then the same 8-leg matrix as Azure: PowerShell 7 on ubuntu/macOS/windows (latest + one previous GA), Windows PowerShell 5.1 on windows (latest + previous). Coverage renders in each run's job summary and a consolidated table, and uploads to Codecov with a flag per leg. GA-only images: floating *-latest plus one pinned previous GA. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
nohwnd
force-pushed
the
ci/gh-actions-pilot
branch
from
July 18, 2026 10:06
64e2f1b to
2177e4b
Compare
Collaborator
|
Add https://github.com/dorny/test-reporter to the test matrix jobs?
Didn't know. 🙁 Good thing we don't use exclusive features here. |
- Publish NUnit3 test results per matrix leg with dorny/test-reporter, a GitHub-native test report (Azure test-tab parity). test.ps1 gains an env-selectable result format (PESTER_TESTRESULT_FORMAT); Azure keeps the default NUnit 2.5, only the pilot switches to NUnit3. - Add Dependabot for github-actions (weekly, grouped, incl. major) to keep the actions current and ahead of Node.js runtime deprecations. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
dorny/test-reporter shells out to git and fails with exit 128 when the leg has no repo checkout (the legs are artifact-only). Add a shallow checkout before the artifact download; the artifact overlays it, so the tests still run against the published build. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Azure PublishTestResults@2 supports NUnit3, so test.ps1 can just emit the modern format for both consumers. Drops the PESTER_TESTRESULT_FORMAT env indirection. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Runs a GitHub Actions workflow in parallel with the existing Azure Pipelines so we can compare the two before deciding whether to move off Azure DevOps.
azure-pipelines.ymlis unchanged — nothing is cut over.Why now: Azure DevOps public projects are being retired (existing ones convert to private in 2027, dropping the free grant from 10 parallel jobs to 1). GitHub Actions is free for public repos with more concurrency (20 vs 10).
What it does: builds once on
windows-latest, then runs the same 8-leg matrix as Azure — PowerShell 7 on ubuntu/macOS/windows (latest + one previous GA), Windows PowerShell 5.1 on windows (latest + previous). Coverage shows in each run's job summary and a consolidated table, and uploads to Codecov with a flag per leg.Images are GA-only: floating
*-latestplus one pinned previous GA.macos-14is deprecating (removed Nov 2026) and will need swapping before then.