Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Implement burn-in logic #28266

Merged
merged 29 commits into from
Nov 28, 2023
Merged

feat: Implement burn-in logic #28266

Show file tree
Hide file tree
Changes from 24 commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
c7e9fb6
Add burn-in logic
MuazOthman Nov 3, 2023
f62f81f
Refactored for unit testing
MuazOthman Nov 7, 2023
ad632cc
Cleaned up code
MuazOthman Nov 7, 2023
425d245
Use burn-in actions from cloud
MuazOthman Nov 8, 2023
17061db
scaffold out how to test burnin thru with mocked server responses
brian-mann Nov 8, 2023
f51e188
Merge branch 'muaz/CYCLOUD-1665-burn-in-logic' of https://github.com/…
brian-mann Nov 8, 2023
f93696f
scaffold in the wiring to pass around the response.actions
brian-mann Nov 8, 2023
ebb217d
bug fix
MuazOthman Nov 8, 2023
9598a6b
Fixed calculateTestStatus tests
MuazOthman Nov 13, 2023
2ef1ebf
Fix tests
MuazOthman Nov 13, 2023
e8e0d2d
Merge remote-tracking branch 'origin/feature/test-burn-in' into muaz/…
MuazOthman Nov 14, 2023
3e75645
Added more tests for burn-in
MuazOthman Nov 15, 2023
4a0c24b
Fixed test snapshots
MuazOthman Nov 15, 2023
2bcf13e
Fixed snapshots
MuazOthman Nov 15, 2023
8885ef0
Fixed snapshots
MuazOthman Nov 15, 2023
97662b4
Fixed snapshots
MuazOthman Nov 15, 2023
4113c62
Added tests for burn-in cases
MuazOthman Nov 16, 2023
e285ea6
Added sample system test for burn-in
MuazOthman Nov 16, 2023
05391cd
Merge branch 'feature/test-burn-in' into muaz/CYCLOUD-1665-burn-in-logic
MuazOthman Nov 16, 2023
fd8a2f4
Fixed protocol snapshot
MuazOthman Nov 17, 2023
d04dd97
Fixed running burn-in w/o retries
MuazOthman Nov 21, 2023
3fadec4
Fixed protocol snapshots
MuazOthman Nov 21, 2023
e69ade2
Fixed hook failed reasonToStop
MuazOthman Nov 27, 2023
15f8fc3
Fixed hook failure reasonToStop
MuazOthman Nov 27, 2023
822006f
Fixed failed hooks data collection and PR feedback
MuazOthman Nov 27, 2023
2b09833
Fixed snapshots
MuazOthman Nov 27, 2023
2d0388c
Fixed snapshots
MuazOthman Nov 27, 2023
9e823d7
Fixed protocol test snapshots
MuazOthman Nov 27, 2023
84f4ed6
Address PR feedback
MuazOthman Nov 28, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
522 changes: 348 additions & 174 deletions packages/app/cypress/e2e/runner/snapshots/retries.experimentalRetries.mochaEvents.cy.ts.json
View file
Open in desktop

Large diffs are not rendered by default.

174 changes: 116 additions & 58 deletions packages/app/cypress/e2e/runner/snapshots/retries.mochaEvents.cy.ts.json
View file
Open in desktop

Large diffs are not rendered by default.

330 changes: 220 additions & 110 deletions packages/app/cypress/e2e/runner/snapshots/runner.experimentalRetries.mochaEvents.cy.ts.json
View file
Open in desktop

Large diffs are not rendered by default.

114 changes: 76 additions & 38 deletions packages/app/cypress/e2e/runner/snapshots/runner.mochaEvents.cy.ts.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -725,7 +725,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -758,7 +759,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -791,7 +793,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -827,7 +830,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -861,7 +865,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -1004,7 +1009,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "failed"
"outerStatus": "failed",
"reasonToStop": "FAILED_HOOK_FAILED"
},
"id": "r4",
"order": 2,
Expand Down Expand Up @@ -1067,7 +1073,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "failed"
"outerStatus": "failed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r4",
"order": 2,
Expand Down Expand Up @@ -1116,7 +1123,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "failed"
"outerStatus": "failed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r4",
"order": 2,
Expand Down Expand Up @@ -1333,7 +1341,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "failed"
"outerStatus": "failed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -1381,7 +1390,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "failed"
"outerStatus": "failed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -1432,7 +1442,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "failed"
"outerStatus": "failed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -1481,7 +1492,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "failed"
"outerStatus": "failed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -1767,7 +1779,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "failed"
"outerStatus": "failed",
"reasonToStop": "FAILED_NO_RETRIES"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -1914,7 +1927,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "failed"
"outerStatus": "failed",
"reasonToStop": "FAILED_NO_RETRIES"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -1996,7 +2010,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "failed"
"outerStatus": "failed",
"reasonToStop": "FAILED_NO_RETRIES"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -2064,7 +2079,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "failed"
"outerStatus": "failed",
"reasonToStop": "FAILED_NO_RETRIES"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -2428,7 +2444,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -2489,7 +2506,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -2565,7 +2583,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -2627,7 +2646,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -2801,7 +2821,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -2834,7 +2855,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -2882,7 +2904,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -2916,7 +2939,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -3202,7 +3226,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -3256,7 +3281,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -3310,7 +3336,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -3367,7 +3394,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -3422,7 +3450,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r3",
"order": 1,
Expand Down Expand Up @@ -3606,7 +3635,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r4",
"order": 2,
Expand Down Expand Up @@ -3653,7 +3683,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r4",
"order": 2,
Expand Down Expand Up @@ -3700,7 +3731,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r4",
"order": 2,
Expand Down Expand Up @@ -3750,7 +3782,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r4",
"order": 2,
Expand Down Expand Up @@ -3798,7 +3831,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r4",
"order": 2,
Expand Down Expand Up @@ -4012,7 +4046,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r5",
"order": 3,
Expand Down Expand Up @@ -4066,7 +4101,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r5",
"order": 3,
Expand Down Expand Up @@ -4135,7 +4171,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r5",
"order": 3,
Expand Down Expand Up @@ -4190,7 +4227,8 @@
"_cypressTestStatusInfo": {
"shouldAttemptsContinue": false,
"attempts": 1,
"outerStatus": "passed"
"outerStatus": "passed",
"reasonToStop": "PASSED_FIRST_ATTEMPT"
},
"id": "r5",
"order": 3,
Expand Down
Loading
Loading