The Operation will be canceled. The next steps may not contain expected logs.

[tarekgh]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=696281

Build leg reported

Build / browser-wasm linux Release LibraryTests / Send to Helix

Pull Request

dotnet/runtime#103009

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The Operation will be canceled. The next steps may not contain expected logs.",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=696281
Error message validated: [The Operation will be canceled. The next steps may not contain expected logs.]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 6/4/2024 8:08:48 PM UTC

Report

Build	Repository	Step Name	Console log	Pull Request
3022093	dotnet-performance	Send job to Helix (Unix)	Log
1507995	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#130636
1508003	dotnet/aspnetcore	Run Quarantined Tests	Log
1507906	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#130670
1507888	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#130631
1507868	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#125662
3021971	dotnet-runtime	Generate CORE_ROOT	Log	#62896
1507951	dotnet/roslyn	Run Unit Tests	Log
1507947	dotnet/runtime	Build product	Log	dotnet/runtime#130639
1507905	dotnet/maui	Controls Image,ImageButton,IndicatorView,InputTransparent,IsEnabled,IsVisible	Log	dotnet/maui#36329
1507939	dotnet/runtime	Build product	Log	dotnet/runtime#129846
1507892	dotnet/maui	Controls Shell	Log	dotnet/maui#36558
3021850	dotnet-dotnet	Validate installer packages	Log
1507760	dotnet/runtime	Publish	Log	dotnet/runtime#130656
3021915	dotnet-dotnet	Build (centOSStreamContainer)	Log
1507751	dotnet/runtime	Publish	Log
1507727	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#128031
1507717	dotnet/runtime	Publish	Log	dotnet/runtime#130665
1507800	dotnet/runtime	Build product	Log	dotnet/runtime#130493
1507699	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#99200
1507772	dotnet/aspnetcore	Run Quarantined Tests	Log
3021879	dotnet-runtime	Install workload using artifacts	Log
1507747	dotnet/aspnetcore	Run Quarantined Tests	Log
1507526	dotnet/runtime	Send to Helix	Log
1507712	dotnet/runtime	Build product	Log	dotnet/runtime#130459
1507626	dotnet/runtime	Send tests to Helix (Windows)	Log
1507660	dotnet/maui	Controls CollectionView	Log
1507571	dotnet/runtime	Publish	Log	dotnet/runtime#129935
1507454	dotnet/maui	Controls CollectionView	Log
1507534	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#130482
1507511	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#130588
3021719	dotnet-sdk	Run Tests in Helix and non Helix in parallel	Log	#62878
3021794	dotnet-docker-tools	🟪 Clean public/dotnet/* (pruneEol > 15d)	Log
1507434	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#130542
1507565	dotnet/runtime	Build product	Log	dotnet/runtime#130584
1507536	dotnet/runtime	Build product	Log	dotnet/runtime#130663
1507391	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#130644
1507385	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#130653
1507497	dotnet/runtime	Build product	Log	dotnet/runtime#130657
1507416	dotnet/runtime	Build product	Log	dotnet/runtime#129924
1507181	dotnet/runtime	Send to Helix	Log
1506571	dotnet/aspnetcore	Run Quarantined Tests	Log	dotnet/aspnetcore#67753
1507089	dotnet/runtime	Send to Helix	Log
1507307	dotnet/aspnetcore	Run Quarantined Tests	Log
1507359	dotnet/runtime	Build product	Log	dotnet/runtime#130459
1507086	dotnet/runtime	Build	Log
1507045	dotnet/runtime	Publish	Log	dotnet/runtime#130272
1506953	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#130643
3021460	dotnet-dotnet	Validate installer packages	Log
1507030	dotnet/runtime	Send to Helix	Log
1507127	dotnet/runtime	Send to Helix	Log	dotnet/runtime#130053
1507265	dotnet/performance	Send job to Helix (Unix)	Log	dotnet/performance#5256
1507165	dotnet/runtime	Send to Helix	Log	dotnet/runtime#130581
1507176	dotnet/runtime	Send to Helix	Log
1507085	dotnet/runtime	Send tests to Helix (Unix)	Log
1507203	dotnet/runtime	Send to Helix	Log	dotnet/runtime#130646
1507107	dotnet/runtime	Send tests to Helix (Windows)	Log
3021552	dotnet-dotnet	Build (centOSStreamContainer)	Log
1507121	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#130528
3021581	dotnet-dotnet	Checkout dotnet-dotnet@dev/ellahathaway/fix-internal-feeds to s	Log
1507162	dotnet/roslyn	Run Unit Tests	Log
1506992	dotnet/maui	Controls Shell	Log	dotnet/maui#36413
1506748	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#130635
1506716	dotnet/runtime	Publish	Log	dotnet/runtime#130639
1506689	dotnet/runtime	Publish	Log	dotnet/runtime#130589
1506659	dotnet/runtime	Publish	Log	dotnet/runtime#130435
1502628	dotnet/runtime	Send to Helix	Log	dotnet/runtime#130405
1506999	dotnet/roslyn	Run Unit Tests	Log
1506766	dotnet/runtime	Build product	Log	dotnet/runtime#130484
1506631	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#129457
1506734	dotnet/runtime	Build product	Log	dotnet/runtime#130481
1506651	dotnet/runtime	Send to Helix	Log	dotnet/runtime#130611
1506616	dotnet/maui	Controls Shell	Log	dotnet/maui#34637
1506648	dotnet/runtime	Send to Helix	Log	dotnet/runtime#130638
1506623	dotnet/maui	Controls Layout	Log	dotnet/maui#36243
1506451	dotnet/runtime	Publish	Log	dotnet/runtime#129761
1504303	dotnet/aspnetcore	Run Quarantined Tests	Log	dotnet/aspnetcore#67736
1506597	dotnet/maui	Controls Shell	Log	dotnet/maui#36328
3021397	dotnet-android	install OpenJDK and accept Android SDK licenses	Log
1506592	dotnet/maui	Controls Image,ImageButton,IndicatorView,InputTransparent,IsEnabled,IsVisible	Log	dotnet/maui#27477
3021412	dotnet-arcade	🛡 Guardian: BinSkim 4.4.9	Log
3021348	dotnet-android	Run tests	Log
1506598	dotnet/maui	DeviceTestsMacCatalyst_CoreCLR (Windows)	Log	dotnet/maui#36328
1506489	dotnet/maui	Controls Layout	Log	dotnet/maui#36541
1506358	dotnet/runtime	Publish	Log	dotnet/runtime#130373
1506349	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#130476
1506559	dotnet/roslyn	Run Unit Tests	Log
1506543	dotnet/maui	Checkout dotnet/maui@refs/pull/36309/merge to s	Log	dotnet/maui#36309
3021285	dotnet-dotnet	Build (centOSStreamContainer)	Log
1506333	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#130622
1506419	dotnet/roslyn	Prepare Test Payload	Log
1506267	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#130082
3021324	dotnet-runtime	Send job to Helix (Unix)	Log
1506445	dotnet/runtime	Build product	Log	dotnet/runtime#130272
1506414	dotnet/runtime	Build product	Log	dotnet/runtime#130584
1506209	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#130512
3021158	dotnet-maui	Controls Label	Log
1506376	dotnet/runtime	Build product	Log	dotnet/runtime#130581
1506223	dotnet/runtime	Build product	Log	dotnet/runtime#130622
1506039	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#130482
Displaying 100 of 3349 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
98	717	3349

[dkurepa]

These appear to be timeout cancellations, and most of them are happening on the same runtime leg that uses OSX.1200.ARM64.Open, looking at grafana, they do indeed appear to be quite high. Will check with the team on what we can do about this

[dkurepa]

For pipelines experiencing timeouts on osx.1200.arm64.open we recommend using osx.14.arm64.open, as this queue has a lot more machines

[dkurepa]

There is also a number of Publish Using Darc timeouts, these are in 99% of cases AzDo Api issues. During the Publish Using Darc job, we queue up a Maestro Promotion pipeline, that downloads the artifacts from the build calling it, and publishes them where they need to go. While publishing is happening, the build pipeline keeps busy waiting for the promotion pipeline to be done, checking the status of it every 60 seconds. In cases where this times out, the build most likely did get promoted, the AzDo API just kept telling us the wrong thing

[ivanpovazan]

@dkurepa for context, the same timeouts are also caught with this tracking #1883
where I asked about potentially bumping the queues to osx.13.amd/arm64, would that suffice?
(bumping to osx.14 is not an option right now as we still want testing on osx.13 which is the minimum supported OS version)

[CarnaViire]

For the "known issues" folks: the timeout here is reported twice, making BA red despite the tracking issue. E.g.:

1️⃣ dotnet/runtime#117255

2️⃣ dotnet/runtime#117800

cc @AlitzelMendez