Arm backend: Fixed numerical difference detection test

[Michiel-Olieslagers]

Change-Id: I5fcd32b128d215c30f50b6e8b4c819312f4e9301

cc @freddan80 @per @zingo @oscarandersson8218 @digantdesai

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15048

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• [ROCm][CI] Machines under the label linux.rocm.gpu.2 are undergoing maintenance.

❌ 10 New Failures, 37 Pending, 7 Unrelated Failures

As of commit cef5f7b with merge base d00279d ():

NEW FAILURES - The following jobs have failed:

• Apple / build-demo-ios / macos-job (gh)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
  RuntimeError: Command docker exec -t d2dc862836f4192402425a15877cd3294364752c833ab0b89c969ccd1d8c14f6 /exec failed with exit code 1
• pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
  RuntimeError: Command docker exec -t 09f178e47c4dbf8218606d466175b7999b9a2311acde66898c6a10be0ef48230 /exec failed with exit code 1
• pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
  RuntimeError: Command docker exec -t 1479dad197059a63a0864338e363ecc381de0779591f308621b891d2540754a2 /exec failed with exit code 1
• pull / test-samsung-models-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 704c20033d905eeaf44542866596393b1549cc43e113ea694f390ce39da519c7 /exec failed with exit code 1
• pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh)
  RuntimeError: Command docker exec -t de241334e0e453183d3069739c41484d31ca9f5a7d5c001e4146153249557cfa /exec failed with exit code 1
• Test CUDA Builds / export-voxtral-cuda-artifact / linux-job (gh)
  RuntimeError: Command docker exec -t 2f37c3c26d062e2229cf670a15e827e9d05d2166f47750c6d6e91a6488df72c4 /exec failed with exit code 2
• Test CUDA Builds / test-models-cuda (conv1d) / linux-job (gh)
  RuntimeError: Command docker exec -t 29bc0ffbd7fc5356ff0a120e5f2be768bc9b7f06f0a6c11144209ce44711a6e6 /exec failed with exit code 1
• trunk / test-arm-backend (test_pytest_ops_ethosu_fvp) / linux-job (gh)
  RuntimeError: Command docker exec -t 7d0e33e29c69d95e64be90159eb3789df03eb90c7fb7cebaea82c430b224d503 /exec failed with exit code 1
• trunk / test-huggingface-transformers-macos (distilbert|coreml_fp32_gpu|--quantize) / macos-job (gh)
  The process '/opt/homebrew/bin/git' failed with exit code 128

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• pull / unittest / linux / linux-job (gh) (matched linux rule in flaky-rules.json)
  The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.
• pull / unittest-editable / linux / linux-job (gh) (matched linux rule in flaky-rules.json)
  The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.
• trunk / test-models-linux-aarch64 (linear, xnnpack-quantization-delegation, linux.arm64.2xlarge) / linux-job (gh) (detected as infra flaky with no log or failing log classifier)

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Apple / build-benchmark-app / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• Apple / build-frameworks-ios / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• trunk / test-coreml-delegate / macos-job (gh) (trunk failure)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• trunk / unittest-release / linux / linux-job (gh) (trunk failure)
  The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[Michiel-Olieslagers]

Loads of Mac unit tests are failing although proposed PR is not related to the Mac workflow. In theory should be a fairly straightforward change to Arm unit tests

[zingo]

Arm fails is splice that is unrelated to this PR an broken on main

[zingo]

@Michiel-Olieslagers there seems to be a lintrunner problem.