Skip to content

Sync eng/common directory with azure-sdk-tools for PR 16402 - #49878

Merged
helen229 merged 2 commits into
mainfrom
sync-eng-common-feat/rename-azsdk-evals-to-evals-16402
Jul 21, 2026
Merged

Sync eng/common directory with azure-sdk-tools for PR 16402#49878
helen229 merged 2 commits into
mainfrom
sync-eng-common-feat/rename-azsdk-evals-to-evals-16402

Conversation

@azure-sdk-automation

Copy link
Copy Markdown
Contributor

Sync eng/common directory with azure-sdk-tools for PR Azure/azure-sdk-tools#16402 See eng/common workflow

Copilot AI review requested due to automatic review settings July 21, 2026 17:57
@azure-sdk-automation
azure-sdk-automation Bot requested a review from a team as a code owner July 21, 2026 17:57
@azure-sdk-automation
azure-sdk-automation Bot requested a review from helen229 July 21, 2026 17:57
@azure-sdk-automation azure-sdk-automation Bot added EngSys This issue is impacting the engineering system. Central-EngSys This issue is owned by the Engineering System team. labels Jul 21, 2026
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 1 pipeline(s).
35 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Note

Copilot could not run the full agentic suite for this review because it was automatically requested on a bot-authored pull request. Request a review from Copilot under Reviewers to retry with the full agentic suite. Improved support for bot-authored pull requests is coming soon.

Updates the eval suite layout assumptions across scripts, tests, and pipelines to use a top-level evals/ directory containing tools/ and workflows/ instead of azsdk-evals/evals/....

Changes:

  • Updated default eval glob patterns to tools/*.eval.yaml and workflows/mock/*.eval.yaml.
  • Refactored test fixtures to create/read eval files under tools/ and workflows/.
  • Adjusted pipeline triggers/parameters and relative-link allowlist to reference evals/**.

Reviewed changes

Copilot reviewed 9 out of 9 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
eng/common/scripts/eval/test/init-eval-git-fixtures.test.ts Updates fixture paths and real-fixture scanning roots to the new evals/tools + evals/workflows layout.
eng/common/scripts/eval/test/collect-stimuli.test.ts Updates test eval file locations and expected -e arguments to align with tools/ and workflows/.
eng/common/scripts/eval/lib/glob.ts Updates JSDoc example glob to match the new directory layout.
eng/common/scripts/eval/init-eval-git-fixtures.ts Updates default fixture-discovery patterns to the new layout.
eng/common/scripts/eval/collect-stimuli.ts Updates default stimuli-discovery patterns to the new layout.
eng/common/scripts/allow-relative-links.txt Updates allowlisted eval suite root from azsdk-evals/** to evals/**.
eng/common/pipelines/workflow-eval.yml Updates path triggers and vallyRoot to use evals.
eng/common/pipelines/templates/stages/archetype-eval.yml Updates default evalGlobs patterns to match tools/ and workflows/.
eng/common/pipelines/live-eval.yml Updates vallyRoot and live eval globs to use evals/workflows/live.

Comment thread eng/common/scripts/eval/test/init-eval-git-fixtures.test.ts
Comment thread eng/common/scripts/eval/test/init-eval-git-fixtures.test.ts
@helen229
helen229 merged commit 51797ac into main Jul 21, 2026
17 checks passed
@helen229
helen229 deleted the sync-eng-common-feat/rename-azsdk-evals-to-evals-16402 branch July 21, 2026 18:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Central-EngSys This issue is owned by the Engineering System team. EngSys This issue is impacting the engineering system.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants