Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failure on Helix tests - Tests timing out #40074

Open
MiYanni opened this issue Apr 9, 2024 · 7 comments
Open

Failure on Helix tests - Tests timing out #40074

MiYanni opened this issue Apr 9, 2024 · 7 comments
Labels
Area-Infrastructure Area-Watch Known Build Error untriaged Request triage from a team member
Milestone
10.0.1xx

Comments

@MiYanni
Copy link
Member

MiYanni commented Apr 9, 2024 •
edited by build-analysis bot
Loading

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=635799
Build error leg or test failing: Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.3.WorkItemExecution
Pull request: #40059

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "END OF WORK ITEM LOG: Command timed out, and was killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=635799
Error message validated: [END OF WORK ITEM LOG: Command timed out, and was killed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/9/2024 5:21:23 PM UTC

Report

Build Definition Test Pull Request
925430 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46213
924828 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46195
925972 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #46220
918817 dotnet/sdk Microsoft.NET.Build.Tests.dll.18.WorkItemExecution #46010
925907 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #46101
925869 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46184
925579 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.20.WorkItemExecution #46186
925765 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45969
925467 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #46215
925445 dotnet/sdk dotnet-watch.Tests.dll.6.WorkItemExecution #46214
925439 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #46108
925397 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45932
925359 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46045
925341 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46211
925270 dotnet/sdk Microsoft.NET.Publish.Tests.dll.2.WorkItemExecution #46209
925259 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45362
925244 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46208
924843 dotnet/sdk Microsoft.NET.Publish.Tests.dll.9.WorkItemExecution #46200
924794 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #46190
924723 dotnet/sdk dotnet.Tests.dll.1.WorkItemExecution #46164
924720 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46141
924714 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46188
924692 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46166
924379 dotnet/sdk Microsoft.NET.Build.Tests.dll.14.WorkItemExecution #46141
924465 dotnet/sdk Microsoft.NET.Build.Tests.dll.16.WorkItemExecution #46179
924419 dotnet/sdk Microsoft.NET.Publish.Tests.dll.2.WorkItemExecution #46178
924389 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #46177
923505 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #46002
924106 dotnet/sdk Microsoft.NET.Publish.Tests.dll.11.WorkItemExecution #45362
924083 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.20.WorkItemExecution #46168
924068 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.21.WorkItemExecution #46142
923901 dotnet/sdk Microsoft.NET.Publish.Tests.dll.9.WorkItemExecution #46164
924003 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46055
923301 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution #46142
923662 dotnet/sdk Microsoft.NET.Publish.Tests.dll.11.WorkItemExecution #46158
923563 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46146
923562 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46145
923127 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46136
923023 dotnet/sdk Microsoft.NET.Build.Tests.dll.17.WorkItemExecution #46127
923345 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46141
923343 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46137
923312 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46143
923210 dotnet/sdk Microsoft.NET.Publish.Tests.dll.9.WorkItemExecution #45932
923196 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46139
922434 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #45997
923136 dotnet/sdk dotnet-watch.Tests.dll.6.WorkItemExecution #46137
923117 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46132
923102 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #46134
923090 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #46045
922994 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45792
922961 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46045
922941 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46102
922912 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46129
922859 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution #46127
922803 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46045
921792 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #46114
922680 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45983
919402 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46033
922193 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46123
922574 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46125
922481 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #46124
922430 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #46100
920211 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45999
922195 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46120
922194 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46117
922156 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45932
922116 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #44611
920657 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45980
922036 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution #46122
921985 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #44611
921889 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46110
921824 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45990
921762 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution #46112
921756 dotnet/sdk Microsoft.NET.Publish.Tests.dll.9.WorkItemExecution #45419
921751 dotnet/sdk Microsoft.NET.Publish.Tests.dll.11.WorkItemExecution #45552
921691 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.21.WorkItemExecution #46110
921547 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45880
921657 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #46069
921527 dotnet/sdk Microsoft.NET.Build.Tests.dll.8.WorkItemExecution #45979
921295 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution #46096
921216 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46064
921142 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46088
920620 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45997
921100 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #46045
920967 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45880
920725 dotnet/sdk dotnet-sln.Tests.dll.2.WorkItemExecution #46034
920580 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #46055
920457 dotnet/sdk Microsoft.NET.Publish.Tests.dll.8.WorkItemExecution #46069
920483 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution
920410 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #46065
920317 dotnet/sdk Microsoft.NET.Publish.Tests.dll.10.WorkItemExecution #46066
920284 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #46063
919906 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #46048
919998 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #46019
919983 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45980
919859 dotnet/sdk Microsoft.NET.Publish.Tests.dll.8.WorkItemExecution #46023
919844 dotnet/sdk dotnet.Tests.dll.16.WorkItemExecution #46051
919810 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #45362
919622 dotnet/sdk Microsoft.NET.Publish.Tests.dll.8.WorkItemExecution #46041
919623 dotnet/sdk Microsoft.NET.Build.Tests.dll.7.WorkItemExecution #46042
Displaying 100 of 292 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
23 103 292
@dotnet-issue-labeler dotnet-issue-labeler bot added Area-Infrastructure untriaged Request triage from a team member labels Apr 9, 2024
@ericstj ericstj mentioned this issue May 20, 2024
Merged
@nagilson
Copy link
Member

@tmat May you please look at this dotnet watch failure?

@tmat
Copy link
Member

tmat commented May 20, 2024 •
edited
Loading

@nagilson I checked a few logs from above and it looks like the failures are in release/8.0.1xx branch. That wouldn't have various test infra fixes.

@nagilson
Copy link
Member

Thank you for checking :) @tmat, which test infra fixes are you referring to? It may be worth porting them over to 8.0.1xx. Any disagreements @marcpopMSFT?

@nagilson
Copy link
Member

We also just hit it in main, so there might be another existing problem: #41045

@ViktorHofer ViktorHofer mentioned this issue Jun 20, 2024
Merged
@ellahathaway ellahathaway mentioned this issue Jul 2, 2024
Closed
@baronfel
Copy link
Member

@tmat this is popping up again in the rc1 branches, when you get back can you take a look?

@tmat
Copy link
Member

tmat commented Aug 15, 2024

@baronfel I can take a look. Do you have a link to the failed run? The test log should be good enough to determine the issue on main/rc1 branches.

@baronfel
Copy link
Member

The helix timeouts are most of the failed tests in this pipeline, but you can't access them right now due to helix auth issues.

@akoeplinger akoeplinger changed the title Darwin Build_Release failure on Helix tests - Tests timing out Failure on Helix tests - Tests timing out Nov 15, 2024
@akoeplinger akoeplinger mentioned this issue Nov 15, 2024
Closed
@marcpopMSFT marcpopMSFT added this to the 10.0.1xx milestone Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Area-Infrastructure Area-Watch Known Build Error untriaged Request triage from a team member
Projects
None yet
Milestone
10.0.1xx
Development

No branches or pull requests
5 participants
@tmat @baronfel @marcpopMSFT @MiYanni @nagilson