Skip to content

Conversation

philipphofmann
Copy link
Member

Add running unit tests for macOS 26.0, macCatalyst 26.0 and tvOS 26.

Fixes GH-6061

#skip-changelog

Add running unit tests for macOS 26.0, macCatalyst 26.0 and tvOS 26.

Fixes GH-6061
Copy link

codecov bot commented Sep 11, 2025

❌ 1 Tests Failed:

Tests completed Failed Passed Skipped
3959 1 3958 14
View the top 2 failed test(s) by shortest run time
iOS_SwiftUI_UITests.LaunchUITests::testNoNewTransactionForSecondCallToBody
Stack Traces | 0s run time
.../iOS-SwiftUI/iOS-SwiftUI-UITests/LaunchUITests.swift:36 - Failed to tap "Form Screen" Button: Timed out while evaluating UI query.
iOS_Swift_UITests.LaunchUITests::testBreadcrumbData
Stack Traces | 0s run time
.../iOS-Swift/iOS-Swift-UITests/BaseUITest.swift:63 - Failed to terminate io.sentry.sample.iOS-Swift:6898: Failed to terminate io.sentry.sample.iOS-Swift:0
View the full list of 1 ❄️ flaky tests
SentryTests.SentrySDKInternalTests::testResumeAndPauseAppHangTracking

Flake rate in main: 14.00% (Passed 43 times, Failed 7 times)

Stack Traces | 0s run time
.../Tests/SentryTests/SentrySDKInternalTests.swift:632 - XCTAssertEqual failed: ("1") is not equal to ("0")

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Comment on lines +104 to +106
let expectedBodyCountRange = (expectedDataCountLower...expectedDataCountUpper)
let actualBodyCount = try XCTUnwrap(request.httpBody?.count)
XCTAssertTrue(expectedBodyCountRange.contains(actualBodyCount), "Expected body size to be in range of \(expectedBodyCountRange), but was \(actualBodyCount)")
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This test once failed in CI for macOS 26. This assertion message now prints more info, so we know what went wrong in case it fails again.

@philipphofmann philipphofmann marked this pull request as ready for review September 11, 2025 07:56
@@ -217,13 +241,6 @@ jobs:
run: ./scripts/start-test-server.sh
- run: ./scripts/ci-select-xcode.sh ${{matrix.xcode}}

- name: Install required platforms for Xcode 26
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The macos-26 runner now has the 26.0 simulators preinstalled

Copy link
Contributor

github-actions bot commented Sep 12, 2025

Performance metrics 🚀

  Plain With Sentry Diff
Startup time 1239.65 ms 1266.60 ms 26.95 ms
Size 23.75 KiB 969.77 KiB 946.02 KiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
d8b2303 1231.53 ms 1249.89 ms 18.35 ms
7908e84 1224.33 ms 1246.39 ms 22.06 ms
83bb978 1238.33 ms 1260.04 ms 21.71 ms
5712478 1220.10 ms 1239.69 ms 19.59 ms
139db8b 1231.50 ms 1258.19 ms 26.69 ms
53b722c 1222.33 ms 1244.90 ms 22.56 ms
9be5373 1215.92 ms 1239.44 ms 23.52 ms
570f725 1206.00 ms 1238.96 ms 32.96 ms
2e79f5f 1220.53 ms 1249.35 ms 28.82 ms
d05d866 1211.78 ms 1230.96 ms 19.18 ms

App size

Revision Plain With Sentry Diff
d8b2303 23.75 KiB 908.02 KiB 884.27 KiB
7908e84 23.74 KiB 872.75 KiB 849.00 KiB
83bb978 23.75 KiB 920.64 KiB 896.89 KiB
5712478 23.75 KiB 969.28 KiB 945.54 KiB
139db8b 23.75 KiB 920.64 KiB 896.89 KiB
53b722c 23.75 KiB 906.08 KiB 882.33 KiB
9be5373 23.75 KiB 866.50 KiB 842.75 KiB
570f725 23.74 KiB 913.38 KiB 889.63 KiB
2e79f5f 23.75 KiB 928.87 KiB 905.12 KiB
d05d866 23.75 KiB 878.60 KiB 854.85 KiB

Previous results on branch: ci/test-on-26-xos

Startup times

Revision Plain With Sentry Diff
beb61a1 1237.08 ms 1254.73 ms 17.65 ms

App size

Revision Plain With Sentry Diff
beb61a1 23.75 KiB 969.78 KiB 946.03 KiB

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add Xcode 26 support to workflows
1 participant