tensor inp0 not found and crash

[theoparis]

GGML seems to crash after spamming that it can't find inp0.

....
;ggml_mpi_graph_compute_pre: tensor 'inp0' not found
;ggml_mpi_graph_compute_pre: tensor 'inp0' not found
;ggml_mpi_graph_compute_pre: tensor 'inp0' not found
GGML_ASSERT: /build/yxbx17ms159n06hw2i20sxapccdcm5hg-source/ggml.c:11077: ne02 == ne12
[gigamachine:532594] *** Process received signal ***
[gigamachine:532594] Signal: Aborted (6)
[gigamachine:532594] Signal code:  (-6)
[gigamachine:532594] [ 0] /nix/store/vq3sdi8l15rzfl5zvmwpafrzis4sm6xf-glibc-2.37-8/lib/libc.so.6(+0x38d30)[0x7f160a972d30]
[gigamachine:532594] [ 1] /nix/store/vq3sdi8l15rzfl5zvmwpafrzis4sm6xf-glibc-2.37-8/lib/libc.so.6(+0x87a8c)[0x7f160a9c1a8c]
[gigamachine:532594] [ 2] /nix/store/vq3sdi8l15rzfl5zvmwpafrzis4sm6xf-glibc-2.37-8/lib/libc.so.6(gsignal+0x16)[0x7f160a972c86]
[gigamachine:532594] [ 3] /nix/store/vq3sdi8l15rzfl5zvmwpafrzis4sm6xf-glibc-2.37-8/lib/libc.so.6(abort+0xd7)[0x7f160a95c8ba]
[gigamachine:532594] [ 4] /nix/store/wx17nq0blj0hs2fiw91f4fh6qyhxsz0q-llama.cpp/lib/libllama.so(+0x3b0f7)[0x7f160af340f7]
[gigamachine:532594] [ 5] /nix/store/wx17nq0blj0hs2fiw91f4fh6qyhxsz0q-llama.cpp/lib/libllama.so(+0x4e2f6)[0x7f160af472f6]
[gigamachine:532594] [ 6] /nix/store/vq3sdi8l15rzfl5zvmwpafrzis4sm6xf-glibc-2.37-8/lib/libc.so.6(+0x85dd4)[0x7f160a9bfdd4]
[gigamachine:532594] [ 7] /nix/store/vq3sdi8l15rzfl5zvmwpafrzis4sm6xf-glibc-2.37-8/lib/libc.so.6(+0x1079b0)[0x7f160aa419b0]
[gigamachine:532594] *** End of error message ***
fish: Job 1, 'GGML_OPENCL_DEVICE=1 nix run 'g…' terminated by signal SIGABRT (Abort)

I used the following command to run the model I downloaded from https://huggingface.co/NikolayKozloff/falcon-7b-GGUF/tree/main.

GGML_OPENCL_DEVICE=1 nix run 'github:ggerganov/llama.cpp#opencl' -- -m models/52468fe965d4fd1c4f7c596665ef5bac2f290f413591bd35cd619143b201375c -p "Building a website can be done in 10 simple steps:" -n 512 --n-gpu-layers 1

If this helps, I have a 1650 ti.

Edit: It seems to work fine on my non-nixos (debian) machine with a 6600 xt and double the vram (8gb).