Issue with Swift-nio-channel on mac mini Sequoia 15.5

[fberndtsson]

From readme file:

There seems to be an issue with swift-nio based SSH on macOS 15.0-15.3.X. Please use macOS 15.4+ for a more reliable experience.

System I have:
Hardware: mac mini m3
OS: Sequoia 15.5
xcode: 16.4

cilicon.yml

source: oci://ghcr.io/cirruslabs/macos-sequoia-xcode:16
provisioner:
  type: gitlab
  config:
    gitlabURL: https://gitlab.com
    runnerToken: token-that-is-secret
    downloadLatest: false

Running with: https://github.com/traderepublic/Cilicon/releases/tag/v2.2.3

---------- Starting Up ----------
---------- Starting Up ----------
---------- Starting Up ----------
zsh: no such file or directory: ./gitlab-runner
The operation couldn’t be completed. (Citadel.SSHClient.CommandFailed error 1.)
---------- Shutting Down ----------
---------- Starting Up ----------

Most often it fails for some "swift-nio-channel" error without any additionally information, which i suppose is related to the issue from Readme. Do we have any idea/workaround of how to fix/troubleshoot it further?

Additional
The issue started after changing the image from: source: oci://ghcr.io/cirruslabs/macos-sonoma-xcode:16 --> to the new sequoia.
I have successfully started and logged into the image with tart with the command: tart run sequoia-xcode-16-3
I tried various other images with same nio-channel issue

• oci://ghcr.io/cirruslabs/macos-sonoma-xcode:16.1
• sequoia-xcode-16-3
• sequoia-xcode-16-2
• sequoia-xcode-16-1
• sequoia-xcode-16

[fberndtsson]

I found a similar issue in the gitlab-tart-executor repository: cirruslabs/gitlab-tart-executor#85 (comment) both are related to SSH.

Before following their suggestions I had the same issue. When starting gitlab-runner via home-brew instead, the gitlab agent was able to ssh into the machine and do the commands.

This makes me think that the issue here, is not exactly Cilicon framework issue, but an gitlab installation issue with the LC_UUID flag?

[fberndtsson]

Update (another "pure" system), with fix of above error

System:

• Mac m2
• OS: Sequoia 15.5

---------- Starting Up ----------
The operation couldn’t be completed. (Citadel.SSHClient.CommandFailed error 1.)
---------- Shutting Down ----------
---------- Starting Up ----------

Runner produces the above error with the configuration:

source: oci://ghcr.io/cirruslabs/macos-sequoia-xcode:15.3
  provisioner:
    type: gitlab
    config:
      gitlabURL: https://gitlab.com
      runnerToken: token-that-is-secret
      downloadLatest: false

Toggle the flag downloadLatest to true, or remove it, makes the cilicon able to start.

The below configuration works:

source: oci://ghcr.io/cirruslabs/macos-sequoia-xcode:15.3
  provisioner:
    type: gitlab
    config:
      gitlabURL: https://gitlab.com
      runnerToken: token-that-is-secret
      downloadLatest: true

This makes me think that the issue is that some permission is required for the copy of the binary that might exist in the home folder.