[Technical Questions] UI Test work locally but fail on github

[Oliviaaaaa-Feng]

UI Test work locally but fail on github

Xcode, Simulator & Previews

Description

We've encountered an issue where our UI tests run successfully locally but fail on GitHub Actions (CI/CD pipeline) with the following error:
Failed to failed to scroll to visible (by AX action) Button, {{202.8, 791.0}, {89.3, 44.2}}, identifier: 'drop.fill', label: 'Hydration', Selected, error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58631, elementOrHash.elementID: 4326457248.32. (Underlying Error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58631, elementOrHash.elementID: 4326457248.32)

Reproduction

import XCTest

final class HydrationHistoryViewTests: XCTestCase {
    @MainActor
    override func setUp() async throws {
        continueAfterFailure = false
        let app = XCUIApplication()
        app.launchArguments = ["--skipOnboarding"]
        app.launch()
    }
    
    @MainActor
    func testHydrationHistoryDisplaysLogs() throws {
        let app = XCUIApplication()
        XCTAssertTrue(app.wait(for: .runningForeground, timeout: 5))
        
        XCTAssertTrue(app.tabBars["Tab Bar"].buttons["Hydration"].exists)
        app.tabBars["Tab Bar"].buttons["Hydration"].tap()
        
        let historyButton = app.segmentedControls.buttons["History"]
        XCTAssertTrue(historyButton.waitForExistence(timeout: 2), "History tab should exist")
        historyButton.tap()
        
        let addButton = app.buttons["Add"]
        addButton.tap()
        
        let logButton = app.buttons["logWaterIntakeButton"]
        XCTAssertTrue(app.staticTexts["20 oz"].waitForExistence(timeout: 2), "Preset button for 20 oz should exist")
        app.staticTexts["20 oz"].tap()
        logButton.tap()
        
        historyButton.tap()
        
        let hydrationLogEntry = app.staticTexts["hydrationLogEntry"]
        XCTAssertTrue(hydrationLogEntry.waitForExistence(timeout: 2), "Hydration log entry should be displayed if logs exist.")
    }
}


### Expected behavior

pass the check

### Additional context

_No response_

### Code of Conduct

- [X] I agree to follow this course's Code of Conduct and Contributing Guidelines

[nriedman]

Hi @Oliviaaaaa-Feng! Have you looked at the build artifact? This will have a video of the UI test so you can see what went wrong. Sometimes during UI tests the simulator will, seemingly at random, shut down and restart. This is an issue with the simulator itself, and the best we can do there is re-run the action and hope it doesn't happen again.

Otherwise, take a look at the build artifact and let me know if you have any questions there!

[nriedman]

Also, I would check which iPhone version the build uses on GitHub. Sometimes it uses an iPhone with a smaller screen, and elements become inaccessible to the UITest even though they appear on screen.

Finally, could you link the relevant PR here so we can take a look?

[nriedman]

Re my comment above: looking at the build artifact, it looks like the simulator used an iPhone 16 Pro with iOS 18.3.1. Also, looking at the build artifact, the test is interrupted by a HealthKit permissions sheet. At some point, a component of the code is accessing HealthKit and needs permission. In order to get permission, a sheet appears like this:

To fix this, I would include code to either block the app from using HealthKit during this test (with launch arguments) or include code in the test setup to grant HealthKit access.

[Oliviaaaaa-Feng]

Hi @nriedman, Thanks for your help!