The docker evaluation doesn't work on arm Mac

[piojanu]

Hi!

I try to run the docker evaluation on M3 MacBook and I get the following error when building docker for instances requiring rasterio:

...
2025-02-17 10:35:25,153 - INFO - Collecting rasterio (from -r /testbed/instance_requirements.txt (line 5))
2025-02-17 10:35:25,226 - INFO - Downloading rasterio-1.4.3.tar.gz (442 kB)
2025-02-17 10:35:25,508 - INFO - Installing build dependencies: started
2025-02-17 10:35:30,580 - INFO - Installing build dependencies: finished with status 'done'
2025-02-17 10:35:30,580 - INFO - Getting requirements to build wheel: started
2025-02-17 10:35:30,706 - INFO - Getting requirements to build wheel: finished with status 'error'
2025-02-17 10:35:30,709 - INFO - error: subprocess-exited-with-error
  
  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [2 lines of output]
      WARNING:root:Failed to get options via gdal-config: [Errno 2] No such file or directory: 'gdal-config'
      ERROR: A GDAL API version must be specified. Provide a path to gdal-config using a GDAL_CONFIG environment variable or use a GDAL_VERSION environment variable.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
2025-02-17 10:35:30,979 - INFO - error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
2025-02-17 10:35:31,126 - INFO - ---> Removed intermediate container b45d37614d44
2025-02-17 10:35:31,129 - ERROR - Error: The command '/bin/sh -c /opt/miniconda3/bin/pip install --exists-action i --no-cache-dir -r /testbed/instance_requirements.txt' returned a non-zero code: 1
2025-02-17 10:35:31,129 - ERROR - docker.errors.BuildError during sab.eval.arm64.14:latest: The command '/bin/sh -c /opt/miniconda3/bin/pip install --exists-action i --no-cache-dir -r /testbed/instance_requirements.txt' returned a non-zero code: 1

I've put quite a bit of time googling the problem: I've tried to install GDAL in various ways I found online, change the base image to 24.04., and change the platform to amd64 with no luck (very different errors at different stages, including the Python runtime). Did you make it working on arm Macs?

Please note, that there are no problems installing rasterio with conda on the arm Mac — the direct evaluation works fine for the instance 14 (it requires rasterio) I was debugging. I've tried to install rasterio using conda inside the container, but I've got some problems with not matching sqllite3 dependency in Python runtime.

Thanks!

[ronch99]

Hi @piojanu, thanks for your post! We will take a look at this issue, but it might take some time. We have not tested the docker evaluation on an arm Mac because our university's policies do not allow us to use docker on our macbook for work. We'll find a personal arm Mac and see how we can help.

[ChenSJ98]

Hi @piojanu, we also failed to make it work on Macs after various attempts. The root problem is that rasterio still doesn't have pre-built wheels for aarch64/arm64 which prevents installation in linux containers running on Apple silicon Macs. Besides, it seems adding support is highly non-trivial (See rasterio/rasterio-wheels#69 for more details). Therefore, please use direct evaluation for affected instances on Macs for now. Thank you for your understanding!