Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The hosted runner encountered an error while running your job. (Error Type: Disconnect). #1919

Open
3 tasks
lewing opened this issue Jan 30, 2024 · 6 comments
Open
3 tasks

Comments

@lewing
Copy link
Member

lewing commented Jan 30, 2024

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=545844

Build leg reported

Build / osx-x64 Release AllSubsets_Mono_LLVMJIT

Pull Request

https://github.com/dotnet/runtime.git/pull/97694

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The hosted runner encountered an error while running your job. (Error Type: Disconnect).",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

  • Feature changes/additions
  • Bug fixes
  • Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build Definition Step Name Console log Pull Request
910714 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110692
910459 dotnet/sdk TestBuild: macOS (arm64) Log dotnet/sdk#44523
910106 dotnet/sdk Darwin Build_Release
909597 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#111108
909308 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#111130
908967 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#111149
908529 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#108799
908317 dotnet/sdk TemplateEngine: macOS (x64) dotnet/sdk#45735
908191 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#111005
907736 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#111112
2613413 dotnet-sdk Official: macOS (arm64)
906583 dotnet/runtime osx-arm64 Release NativeAOT_Libraries dotnet/runtime#111015
2612345 dotnet-runtime iossimulator-x64 release NativeAOT
904437 dotnet/runtime coreclr Pri0 Runtime Tests Run osx arm64 checked dotnet/runtime#111006
903351 dotnet/runtime osx-x64 Debug AllSubsets_Mono_LLVMAOT dotnet/runtime#107118
903326 dotnet/machinelearning MacOS_x64 Debug_Build dotnet/machinelearning#7351
902432 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110888
902217 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110915
902223 dotnet/sdk AoT: macOS (x64) dotnet/sdk#45621
902066 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110856
901257 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110845
2605711 dotnet-runtime osx-arm64 release Mono
900030 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110842
899914 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#108542
899891 dotnet/runtime osx-x64 release Installer_Build_And_Test
898601 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110641
897902 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#101356
897613 dotnet/runtime maccatalyst-x64 release MonoAOTOffsets dotnet/runtime#110688
897504 dotnet/sdk AoT: macOS (x64) dotnet/sdk#44611
897226 dotnet/sdk AoT: macOS (x64) dotnet/sdk#45497
895916 dotnet/sdk AoT: macOS (x64) dotnet/sdk#44862
895127 dotnet/runtime osx-x64 Release AllSubsets_Mono dotnet/runtime#110676
894212 dotnet/sdk AoT: macOS (x64) dotnet/sdk#45430
893832 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110627
893066 dotnet/runtime osx-x64 Debug AllSubsets_Mono_LLVMAOT dotnet/runtime#110632
892857 dotnet/sdk TestBuild: macOS (x64) dotnet/sdk#45298
892798 dotnet/runtime osx-x64 release Installer_Build_And_Test
892733 dotnet/runtime tvos-arm64 Release AllSubsets_NativeAOT dotnet/runtime#110580
892604 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110550
890849 dotnet/sdk TestBuild: macOS (arm64) Log dotnet/sdk#45327
891420 dotnet/sdk AoT: macOS (x64) dotnet/sdk#44268
891154 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110569

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
2 13 42

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=545844
Error message validated: The hosted runner encountered an error while running your job. (Error Type: Disconnect).
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/5/2024 8:24:46 PM UTC

@dougbu
Copy link
Member

dougbu commented Jan 30, 2024

this looks a bunch like a low-level and transient issue in AzDO. they provide the macOS-12 images and, somehow, they're responsible for something (somewhere) deciding to deprovision the agent the job started on. have you seen this more than once❔

@garath
Copy link
Member

garath commented Jan 31, 2024

Are you trying to use the "known error" feature here to find other occurances? There is no error message or pattern listed in the configuration blob of this issue, so it won't match to anything.

@dougbu
Copy link
Member

dougbu commented Feb 1, 2024

not sure but we may not have any telemetry containing the interesting lines because they occur between build steps

##[error]The hosted runner encountered an error while running your job. (Error Type: Disconnect).
,##[warning]Received request to deprovision: The request was cancelled by the remote provider.

and, in place of a step's log

Nothing to show. Final logs are missing. This can happen when the job is cancelled or times out.

@garath, @AlitzelMendez, @missymessa, do we preserve any logs other than those for individual build steps (and Helix work items) for known issue matching❔

@garath
Copy link
Member

garath commented Feb 1, 2024

do we preserve any logs other than those for individual build steps (and Helix work items) for known issue matching❔

No. If AzDO isn't showing the log, then it's likely the data never got captured into AzDO's database. Everything else is driven from that.

@lewing
Copy link
Member Author

lewing commented Feb 6, 2024

not sure but we may not have any telemetry containing the interesting lines because they occur between build steps

##[error]The hosted runner encountered an error while running your job. (Error Type: Disconnect).
,##[warning]Received request to deprovision: The request was cancelled by the remote provider.

and, in place of a step's log

Nothing to show. Final logs are missing. This can happen when the job is cancelled or times out.

@garath, @AlitzelMendez, @missymessa, do we preserve any logs other than those for individual build steps (and Helix work items) for known issue matching❔

I didn't expect it to work so I didn't add the message at first but it does appear to be able to match on that so I updated it and now some results are showing up.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants