Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

backup: TestCloudBackupRestoreAzure failed #140762

Open
cockroach-teamcity opened this issue Feb 8, 2025 · 2 comments
Open

backup: TestCloudBackupRestoreAzure failed #140762

cockroach-teamcity opened this issue Feb 8, 2025 · 2 comments
Labels
A-disaster-recovery branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Feb 8, 2025 •
edited by cockroach-jira-scripts
Loading

backup.TestCloudBackupRestoreAzure failed with artifacts on master @ 0d284cc52708504d8c71c4358041f45fcf792a52:

        --------------------------------------------------------------------------------
        RESPONSE 401 Unauthorized
        --------------------------------------------------------------------------------
        {
          "error": "invalid_client",
          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: d4d47250-b379-4f3d-8030-a66a39bc0100 Correlation ID: 23bdccfb-60f6-4983-b230-ac5303b814ef Timestamp: 2025-02-08 00:09:33Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-08 00:09:33Z",
          "trace_id": "d4d47250-b379-4f3d-8030-a66a39bc0100",
          "correlation_id": "23bdccfb-60f6-4983-b230-ac5303b814ef",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
        To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-secret
        POST https://login.microsoftonline.com/166ae090-e164-40b7-b4f0-763fba013597/oauth2/v2.0/token
        --------------------------------------------------------------------------------
        RESPONSE 401 Unauthorized
        --------------------------------------------------------------------------------
        {
          "error": "invalid_client",
          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: d4d47250-b379-4f3d-8030-a66a39bc0100 Correlation ID: 23bdccfb-60f6-4983-b230-ac5303b814ef Timestamp: 2025-02-08 00:09:33Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-08 00:09:33Z",
          "trace_id": "d4d47250-b379-4f3d-8030-a66a39bc0100",
          "correlation_id": "23bdccfb-60f6-4983-b230-ac5303b814ef",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
        POST https://login.microsoftonline.com/166ae090-e164-40b7-b4f0-763fba013597/oauth2/v2.0/token
        --------------------------------------------------------------------------------
        RESPONSE 401 Unauthorized
        --------------------------------------------------------------------------------
        {
          "error": "invalid_client",
          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: d4d47250-b379-4f3d-8030-a66a39bc0100 Correlation ID: 23bdccfb-60f6-4983-b230-ac5303b814ef Timestamp: 2025-02-08 00:09:33Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-08 00:09:33Z",
          "trace_id": "d4d47250-b379-4f3d-8030-a66a39bc0100",
          "correlation_id": "23bdccfb-60f6-4983-b230-ac5303b814ef",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
    testutils.go:307: no Invalid Descriptors
    --- FAIL: TestCloudBackupRestoreAzure/storage_auth_legacy/kms_auth_implicit (1.95s)
Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-47351
@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery labels Feb 8, 2025
This was referenced Feb 8, 2025
Open
Open
@cockroach-teamcity
Copy link
Member Author

backup.TestCloudBackupRestoreAzure failed with artifacts on master @ ecfb74b7ad75327f11814966a2cdab1b9793a549:

        --------------------------------------------------------------------------------
        RESPONSE 401 Unauthorized
        --------------------------------------------------------------------------------
        {
          "error": "invalid_client",
          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: f0b7c9e9-3d43-46a5-9656-a7ef80501000 Correlation ID: 3a592ce7-0d19-4aa1-a30d-f31340b7ee94 Timestamp: 2025-02-09 00:09:49Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-09 00:09:49Z",
          "trace_id": "f0b7c9e9-3d43-46a5-9656-a7ef80501000",
          "correlation_id": "3a592ce7-0d19-4aa1-a30d-f31340b7ee94",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
        To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-secret
        POST https://login.microsoftonline.com/166ae090-e164-40b7-b4f0-763fba013597/oauth2/v2.0/token
        --------------------------------------------------------------------------------
        RESPONSE 401 Unauthorized
        --------------------------------------------------------------------------------
        {
          "error": "invalid_client",
          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: f0b7c9e9-3d43-46a5-9656-a7ef80501000 Correlation ID: 3a592ce7-0d19-4aa1-a30d-f31340b7ee94 Timestamp: 2025-02-09 00:09:49Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-09 00:09:49Z",
          "trace_id": "f0b7c9e9-3d43-46a5-9656-a7ef80501000",
          "correlation_id": "3a592ce7-0d19-4aa1-a30d-f31340b7ee94",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
        POST https://login.microsoftonline.com/166ae090-e164-40b7-b4f0-763fba013597/oauth2/v2.0/token
        --------------------------------------------------------------------------------
        RESPONSE 401 Unauthorized
        --------------------------------------------------------------------------------
        {
          "error": "invalid_client",
          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: f0b7c9e9-3d43-46a5-9656-a7ef80501000 Correlation ID: 3a592ce7-0d19-4aa1-a30d-f31340b7ee94 Timestamp: 2025-02-09 00:09:49Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-09 00:09:49Z",
          "trace_id": "f0b7c9e9-3d43-46a5-9656-a7ef80501000",
          "correlation_id": "3a592ce7-0d19-4aa1-a30d-f31340b7ee94",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
    testutils.go:307: no Invalid Descriptors
    --- FAIL: TestCloudBackupRestoreAzure/storage_auth_legacy/kms_auth_implicit (3.90s)
Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

backup.TestCloudBackupRestoreAzure failed with artifacts on master @ d65ba4b969eb796f8fafd125f11b8a1ad437b17a:

          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: 0d727cc4-8819-493e-8e32-8e9546981f00 Correlation ID: 21f3aa6d-e22c-405e-b198-31706f8e170e Timestamp: 2025-02-10 00:12:10Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-10 00:12:10Z",
          "trace_id": "0d727cc4-8819-493e-8e32-8e9546981f00",
          "correlation_id": "21f3aa6d-e22c-405e-b198-31706f8e170e",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
        POST https://login.microsoftonline.com/166ae090-e164-40b7-b4f0-763fba013597/oauth2/v2.0/token
        --------------------------------------------------------------------------------
        RESPONSE 401 Unauthorized
        --------------------------------------------------------------------------------
        {
          "error": "invalid_client",
          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: 0d727cc4-8819-493e-8e32-8e9546981f00 Correlation ID: 21f3aa6d-e22c-405e-b198-31706f8e170e Timestamp: 2025-02-10 00:12:10Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-10 00:12:10Z",
          "trace_id": "0d727cc4-8819-493e-8e32-8e9546981f00",
          "correlation_id": "21f3aa6d-e22c-405e-b198-31706f8e170e",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
    testutils.go:307: no Invalid Descriptors
    --- FAIL: TestCloudBackupRestoreAzure/storage_auth_legacy/kms_auth_implicit (5.31s)
=== RUN   TestCloudBackupRestoreAzure/storage_auth_explicit/kms_auth_explicit
    backup_test.go:903: error scanning '&{0xc00c02d8c0 <nil>}': pq: failed to create azure reader: ClientSecretCredential authentication failed. FromClientSecret(): http call(https://login.microsoftonline.com/166ae090-e164-40b7-b4f0-763fba013597/oauth2/v2.0/token)(POST) error: reply status code was 401:
        {"error":"invalid_client","error_description":"AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: c26bc413-cadb-47cf-9617-01d0df7f2000 Correlation ID: 09369cf8-649d-4a59-86b2-e56587d04f79 Timestamp: 2025-02-10 00:12:19Z","error_codes":[7000222],"timestamp":"2025-02-10 00:12:19Z","trace_id":"c26bc413-cadb-47cf-9617-01d0df7f2000","correlation_id":"09369cf8-649d-4a59-86b2-e56587d04f79","error_uri":"https://login.microsoftonline.com/error?code=7000222"}
        POST https://login.microsoftonline.com/166ae090-e164-40b7-b4f0-763fba013597/oauth2/v2.0/token
        --------------------------------------------------------------------------------
        RESPONSE 401 Unauthorized
        --------------------------------------------------------------------------------
        {
          "error": "invalid_client",
          "error_description": "AADSTS7000222: The provided client secret keys for app 'b25619ee-01af-4bd2-bc4c-9650ea365920' are expired. Visit the Azure portal to create new keys for your app: https://aka.ms/NewClientSecret, or consider using certificate credentials for added security: https://aka.ms/certCreds. Trace ID: c26bc413-cadb-47cf-9617-01d0df7f2000 Correlation ID: 09369cf8-649d-4a59-86b2-e56587d04f79 Timestamp: 2025-02-10 00:12:19Z",
          "error_codes": [
            7000222
          ],
          "timestamp": "2025-02-10 00:12:19Z",
          "trace_id": "c26bc413-cadb-47cf-9617-01d0df7f2000",
          "correlation_id": "09369cf8-649d-4a59-86b2-e56587d04f79",
          "error_uri": "https://login.microsoftonline.com/error?code=7000222"
        }
        --------------------------------------------------------------------------------
        To troubleshoot, visit https://aka.ms/azsdk/go/identity/troubleshoot#client-secret
    testutils.go:307: no Invalid Descriptors
    --- FAIL: TestCloudBackupRestoreAzure/storage_auth_explicit/kms_auth_explicit (3.99s)
Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
A-disaster-recovery branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@cockroach-teamcity