Add app-level dependency graph filtering for CI/CD build optimization by Groenbech96 · Pull Request #7111 · microsoft/BCApps

Groenbech96 · 2026-03-12T15:01:47Z

Intent

Skip test execution for unaffected apps in CI. AL-Go runs tests for every app in a project even when only one app changed. This adds a check in RunTestsInBcContainer.ps1 that skips tests for apps outside the dependency graph of changed files.

How it works

AL-Go calls RunTestsInBcContainer.ps1 once per test app with $parameters["appName"]. The new code:

Gets changed files via git diff against the base branch
Builds a dependency graph from all app.json files (~329 apps)
Maps changed files to apps, then BFS downstream through dependents
If the current test app is not in the affected set, returns $true (skip)

Safe defaults: skipping is disabled outside CI, on workflow_dispatch, and when BUILD_OPTIMIZATION_DISABLED=true.

Changes

File	What
`build/scripts/BuildOptimization.psm1`	New module: dependency graph, affected app computation, skip decision (165 lines)
`build/scripts/RunTestsInBcContainer.ps1`	4 lines added: import module, check skip, early return
`build/scripts/tests/BuildOptimization.Test.ps1`	18 Pester 5 tests
`.github/AL-Go-Settings.json`	Enable `incrementalBuilds` with `modifiedApps` (compile-side optimization from AL-Go)

What this does NOT do

Does not modify YAML workflows (managed by AL-Go)
Does not skip compilation (handled separately by AL-Go incrementalBuilds)

Introduces BuildOptimization.psm1 that builds a dependency graph from all 329 app.json files and filters appFolders/testFolders per project to only include affected apps. This reduces build times significantly for PRs that touch a small subset of apps (e.g., E-Document Core: 9 apps instead of ~55). Includes a small test change in E-Document Core to verify filtering in CI. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

build/scripts/tests/BuildOptimization.Test.ps1

Groenbech96 · 2026-03-17T16:32:55Z

build/scripts/BuildOptimization.psm1

+        }
+    }
+
+    return $graph


Known PSScriptAnalyzer limitation — PowerShell unwraps single-element arrays to System.Object[] at runtime, so the actual return type never matches the declared [OutputType]. The attributes are correct for documentation purposes. Applies to all OutputType alerts on this file.

build/scripts/BuildOptimization.psm1

github-actions · 2026-03-12T15:03:48Z

Could not find a linked ADO work item. Please link one by using the pattern 'AB#' followed by the relevant work item number. You may use the 'Fixes' keyword to automatically resolve the work item when the pull request is merged. E.g. 'Fixes AB#1234'

git writes progress info to stderr (e.g., "From https://..."), which PowerShell treats as a terminating error under $errorActionPreference=Stop. Switch to Continue around git calls and pipe stderr to Out-Null for fetch. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Shallow checkouts in CI don't have the base commit or parent history, so git diff fails. Use gh pr diff --name-only which queries the GitHub API and works regardless of checkout depth. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Will revert after verifying the filtering works in CI. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

- Non-src files (workflows, build scripts) no longer trigger full build safety fallback — only unmapped files under src/ do - Normalize backslashes to forward slashes when matching project keys (AL-Go uses backslashes, our keys use forward slashes) - Use PSObject.Properties indexer for keys with special chars - Add grouped logging showing which apps are in scope for compile/test Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

build/scripts/BuildOptimization.psm1

Shows a clear list of which apps will be compiled and tested per project, distinguishing between filtered and full build projects. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Revert all YAML changes (off-limits, managed by AL-Go). Add incrementalBuilds setting with mode: modifiedApps for compile filtering. Add test skip logic in RunTestsInBcContainer.ps1 using BuildOptimization module. - Compile filtering: AL-Go native incrementalBuilds reuses prebuilt .app files - Test filtering: Test-ShouldSkipTestApp skips unaffected test apps with caching - Add Get-ChangedFilesForCI for CI environment detection - Add [OutputType] attributes to fix PSScriptAnalyzer warnings - 31 Pester tests passing Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

build/scripts/BuildOptimization.psm1

Remove [SuppressMessageAttribute] that broke Pester's variable scoping in PowerShell 7 CI environment. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

… builds This is temporary — will be reverted after verifying that incrementalBuilds and test skipping work correctly in CI. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Restore build/* pattern. incrementalBuilds can't be smoke-tested from this PR because AL-Go forces full build when .github/*.json changes. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

- YAML files point to Groenbech96/AL-Go fork with ignoreSettingsChanges - AL-Go-Settings.json: ignoreSettingsChanges=true, removed build/* from fullBuildPatterns - Will revert after verifying incremental builds work Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Our YAML changes match the workflow patterns. Remove temporarily for smoke test. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Restore YAML files to main, restore fullBuildPatterns, remove ignoreSettingsChanges. incrementalBuilds with modifiedApps cannot help BCApps because System Application dependency cascade rebuilds all W1 apps on any System App change. Test skipping in RunTestsInBcContainer is the primary optimization. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

…ation-app-level-filtering

- Merged main (Shopify + DotNet Aliases changes now in baseline) - Rewrote BuildOptimization.psm1: 680 → 165 lines, removed V1 dead code, disk cache, upstream BFS, duplicate fullBuildPatterns check - Cleared fullBuildPatterns to allow testing (will restore) Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

build/scripts/BuildOptimization.psm1

+            [void]$directlyChanged.Add($appId)
+        } elseif ($file.Replace('\', '/') -match '(^|/)src/') {
+            # Unmapped file under src/ — safety fallback to full build
+            return @($Graph.Keys)


build/scripts/BuildOptimization.psm1

- Add PSDoc help comments to all 5 functions (PSScriptAnalyzer requirement) - Add [OutputType()] attributes to all functions - Remove accidentally committed .claude/settings.local.json Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

build/scripts/BuildOptimization.psm1

Production-ready: only BuildOptimization module, RunTestsInBcContainer skip logic, incrementalBuilds setting, and tests. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

…sts when only infrastructure files change When files matching fullBuildPatterns (e.g., build/*) change, AL-Go forces a full compile but the test-skip logic saw zero affected apps and skipped all tests. Add Test-FullBuildPatternsMatch to read fullBuildPatterns from AL-Go-Settings.json and short-circuit Test-ShouldSkipTestApp so all tests run when a full build is triggered. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

…ation-app-level-filtering

…re/build-optimization-app-level-filtering

… logging The three-dot git diff (origin/base...HEAD) failed silently in CI because shallow clones lack the merge base history. Now reads the GitHub event payload ($GITHUB_EVENT_PATH) to get base/head commit SHAs and uses a two-dot diff, matching what AL-Go itself does. Also adds BUILD OPTIMIZATION: logging to all early return paths so failures are visible in CI logs instead of producing complete silence. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

The pull_request and push event payload tests use HEAD~1 which doesn't exist in GitHub Actions shallow clones (depth=1). Skip gracefully with Set-ItResult -Skipped when the parent commit is unavailable. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

build/scripts/BuildOptimization.psm1

+        return $null
+    }
+
+    $event = Get-Content $env:GITHUB_EVENT_PATH -Raw | ConvertFrom-Json


build/scripts/BuildOptimization.psm1

+            return $null
+        }
+
+        return $files


Groenbech96 requested review from a team as code owners March 12, 2026 15:01

github-actions bot added Build: Automation Workflows and other setup in .github folder Build: scripts & configs Build scripts and configuration files AL: Apps (W1) Add-on apps for W1 labels Mar 12, 2026

github-advanced-security bot found potential problems Mar 12, 2026

View reviewed changes

Magnus Hartvig Grønbech and others added 4 commits March 12, 2026 16:07

TEMP: Skip fullBuildPatterns check to test dependency filtering

f5b6b9e

Will revert after verifying the filtering works in CI. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

github-advanced-security bot found potential problems Mar 12, 2026

View reviewed changes

build/scripts/BuildOptimization.psm1 Fixed Show fixed Hide fixed

build/scripts/BuildOptimization.psm1 Fixed Show fixed Hide fixed

Magnus Hartvig Grønbech and others added 5 commits March 12, 2026 16:28

Add Determine Apps to Build step with [Project] -> [App] output

1182524

Shows a clear list of which apps will be compiled and tested per project, distinguishing between filtered and full build projects. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Fix Join-Path with 3 args (not supported in PS 5.1)

9175959

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Fix same Join-Path 3-arg issue in _BuildALGoProject.yaml

851d128

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Add SPEC.md and PLAN.md for build optimization

ae00b48

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

github-advanced-security bot found potential problems Mar 13, 2026

View reviewed changes

build/scripts/BuildOptimization.psm1 Fixed Show fixed Hide fixed

build/scripts/BuildOptimization.psm1 Fixed Show fixed Hide fixed

Magnus Hartvig Grønbech and others added 8 commits March 13, 2026 15:12

Fix $graph variable scoping in Pester tests

88c0648

Remove [SuppressMessageAttribute] that broke Pester's variable scoping in PowerShell 7 CI environment. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

TEMP: Remove build/* from fullBuildPatterns to smoke test incremental…

2c4503c

… builds This is temporary — will be reverted after verifying that incrementalBuilds and test skipping work correctly in CI. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Revert temp fullBuildPatterns change

682e248

Restore build/* pattern. incrementalBuilds can't be smoke-tested from this PR because AL-Go forces full build when .github/*.json changes. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

TEMP: Also remove workflow patterns from fullBuildPatterns

769a107

Our YAML changes match the workflow patterns. Remove temporarily for smoke test. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Merge remote-tracking branch 'origin/main' into feature/build-optimiz…

a126ede

…ation-app-level-filtering

Groenbech96 requested a review from a team as a code owner March 14, 2026 09:44

Groenbech96 requested a review from JannikBausager March 14, 2026 09:44

github-advanced-security bot found potential problems Mar 14, 2026

View reviewed changes

build/scripts/BuildOptimization.psm1 Show resolved Hide resolved

Remove PLAN/SPEC/E-Doc test change, restore fullBuildPatterns

6bf00cf

Production-ready: only BuildOptimization module, RunTestsInBcContainer skip logic, incrementalBuilds setting, and tests. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

github-actions bot removed the AL: Apps (W1) Add-on apps for W1 label Mar 14, 2026

Magnus Hartvig Grønbech and others added 4 commits March 17, 2026 17:02

Merge remote-tracking branch 'origin/main' into feature/build-optimiz…

f47a957

…ation-app-level-filtering

Merge branch 'main' of https://github.com/microsoft/BCApps into featu…

a335739

…re/build-optimization-app-level-filtering

Fix algo settings

14222ce

github-actions bot removed the Build: Automation Workflows and other setup in .github folder label Mar 17, 2026

This was referenced Mar 18, 2026

Test: Verify build optimization test-skipping #7207

Closed

Test: Verify build optimization test-skipping #7208

Closed

github-advanced-security bot found potential problems Mar 18, 2026

View reviewed changes

Conversation

Groenbech96 commented Mar 12, 2026 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Intent

How it works

Changes

What this does NOT do

Uh oh!

Uh oh!

Check notice

Groenbech96 Mar 17, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented Mar 12, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Check notice

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Check warning

Check notice

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Groenbech96 commented Mar 12, 2026 •

edited by github-actions bot

Loading