[Error] Failed to find objfile or not a valid file format #68
Description
Getting the following error on my arch linux with cuda 12.8 (nvidia rtx 4060) when model is downloaded successfully and is just about to run from the node which were present in your provided workflow :
got prompt
[ComfyUI-Upscaler-Tensorrt|INFO] - Downloading https://huggingface.co/yuvraj108c/ComfyUI-Upscaler-Onnx/resolve/main/4x_NMKD-Siax_200k.onnx
/home/vu/models/flux/nunchaku-project/ComfyUI/models/onnx/4x_NMKD-Siax_200k.onnx: 20%|███ | 13.8M/68.3M [00:02<00:06, 8.65MiB/s]FETCH ComfyRegistry Data: 35/93
/home/vu/models/flux/nunchaku-project/ComfyUI/models/onnx/4x_NMKD-Siax_200k.onnx: 95%|██████████████▎| 65.1M/68.3M [00:08<00:00, 8.86MiB/s]FETCH ComfyRegistry Data: 40/93
/home/vu/models/flux/nunchaku-project/ComfyUI/models/onnx/4x_NMKD-Siax_200k.onnx: 100%|███████████████| 68.3M/68.3M [00:09<00:00, 7.72MiB/s]
[ComfyUI-Upscaler-Tensorrt|INFO] - Building TensorRT engine for /home/vu/models/flux/nunchaku-project/ComfyUI/models/onnx/4x_NMKD-Siax_200k.onnx: /home/vu/models/flux/nunchaku-project/ComfyUI/models/tensorrt/upscaler/4x_NMKD-Siax_200k_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.13.2.6.trt
Numba: Attempted to fork from a non-main thread, the TBB library may be in an invalid state in the child process.
GEF for linux ready, typegef' to start,gef config' to configure
93 commands loaded and 5 functions added for GDB 16.3 in 0.00ms using Python engine 3.13
[New LWP 55771]
[New LWP 55593]
[New LWP 55592]
[New LWP 55591]
[New LWP 55590]
[New LWP 55589]
[New LWP 55541]
[New LWP 55513]
[New LWP 55511]
[New LWP 55512]
[New LWP 55510]
[New LWP 55509]
[New LWP 55508]
[New LWP 55507]
[New LWP 55506]
[New LWP 55505]
[New LWP 55504]
[New LWP 55503]
[New LWP 55502]
[New LWP 55501]
[New LWP 55500]
[New LWP 55499]
[New LWP 55484]
[New LWP 55420]
[New LWP 55419]
[New LWP 55418]
[New LWP 55417]
[New LWP 55386]
[New LWP 55385]
[New LWP 55384]
This GDB supports auto-downloading debuginfo from the following URLs:
https://debuginfod.archlinux.org
Debuginfod has been disabled.
To make this setting permanent, add 'set debuginfod enabled off' to .gdbinit.
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/PIL/../pillow.libs/libXau-154567c4.so.6.0.0'
Function(s) ^std::(move|forward|as_const|(__)?addressof) will be skipped when stepping.
Function(s) ^std::(shared|unique)_ptr<.>::(get|operator) will be skipped when stepping.
Function(s) ^std::(basic_string|vector|array|deque|(forward_)?list|(unordered_|flat_)?(multi)?(map|set)|span)<.>::(c?r?(begin|end)|front|back|data|size|empty) will be skipped when stepping.
Function(s) ^std::(basic_string|vector|array|deque|span)<.>::operator.] will be skipped when stepping.
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/numpy/core/../../numpy.libs/libgfortran-040039e1.so.5.0.0'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/av/../av.libs/libdrm-b0291a67.so.2.4.0'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/av/../av.libs/libxcb-5ddf6756.so.1.1.0'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/av/../av.libs/libxcb-shm-0be6dfbf.so.0.0.0'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/av/../av.libs/libxcb-shape-7716c890.so.0.0.0'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/av/../av.libs/libxcb-xfixes-6de855b8.so.0.0.0'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/av/../av.libs/libssl-60250281.so.1.1.1k'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/av/../av.libs/libcrypto-bdaed0ea.so.1.1.1k'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/av/../av.libs/libmvec-2-8eb5c230.28.so'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/scipy/special/../../scipy.libs/libgfortran-040039e1-0352e75f.so.5.0.0'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/cv2/../opencv_contrib_python_headless.libs/libopenblas-r0-f650aae0.3.3.so'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/simsimd./libmvec-2-06864e43.28.so'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: '.gnu_debugdata for /home/vu/models/flux/nunchaku-project/venv/lib/python3.11/site-packages/simsimd./libgomp-870cb1d0.so.1.0.0'
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/usr/lib/libthread_db.so.1".
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: 'in-memory@0x5cb3de333dd0-0x5cb3de364228'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: 'in-memory@0x5cb3dbea5dd0-0x5cb3dbed7ed0'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: 'in-memory@0x5cb3dbe82190-0x5cb3dbe9c1d8'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: 'in-memory@0x5cb3dc61fbf0-0x5cb3dc623630'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: 'in-memory@0x5cb3dc5c7bb0-0x5cb3dc5c8f68'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: 'in-memory@0x5cb3dc5a2df0-0x5cb3dc5a3e38'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: 'in-memory@0x5cb3dc5963d0-0x5cb3dc597fd8'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: 'in-memory@0x5cb3dc570060-0x5cb3dc572718'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: 'in-memory@0x5cb3dc2f43a0-0x5cb3dc2f6270'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: 'in-memory@0x5cb3dc419c90-0x5cb3dc41ac20'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: 'in-memory@0x5cb3dc45b0f0-0x5cb3dc45ce90'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: 'in-memory@0x5cb3dc441900-0x5cb3dc453ee0'
[] Failed to find objfile or not a valid file format: [Errno 2] No such file or directory: 'in-memory@0x5cb3dc28fac0-0x5cb3dc292f18'
[ Legend: Modified register | Code | Heap | Stack | String ]
──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── registers ────
$rax : 0xfffffffffffffffc
$rbx : 0x000072fb512f9b18 → 0x00005cb3cdd865b0 → 0x000072f9ec003f50 → 0x000072f9ec004a60 → 0x000072f9ec005850 → 0x00005cb3d61ae360 → 0x00005cb3dc62d3a0 → 0x00005cb3df356510
$rcx : 0x000072fb50cade22 → ret
$rdx : 0x3
$rsp : 0x00007fff60e8d938 → 0x000072fb50ca1fda → mov r11, QWORD PTR [rbp-0x18]
$rbp : 0x00007fff60e8d970 → 0x00007fff60e8d990 → 0x00007fff60e8d9b0 → 0x00007fff60e8da30 → 0x00007fff60e8db80 → 0x00007fff60e8dbb0 → 0x00007fff60e8dc30 → 0x00007fff60e8dc70
$rsi : 0x000072f935da0510 → 0x0000000000000000
$rdi : 0x2b
$rip : 0x000072fb50cade22 → ret
$r8 : 0x0
$r9 : 0x0
$r10 : 0x177
$r11 : 0x246
$r12 : 0x000072fb51420b08 → 0x0000000000000000
$r13 : 0x3
$r14 : 0x000072f9f7833b10 → 0x0000000000000002
$r15 : 0x000072f935da0510 → 0x0000000000000000
$eflags: [ZERO carry PARITY adjust sign trap INTERRUPT direction overflow resume virtualx86 identification]
$cs: 0x33 $ss: 0x2b $ds: 0x00 $es: 0x00 $fs: 0x00 $gs: 0x00
──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── stack ────
0x00007fff60e8d938│+0x0000: 0x000072fb50ca1fda → mov r11, QWORD PTR [rbp-0x18] ← $rsp
0x00007fff60e8d940│+0x0008: 0x000072fb51420e88 → 0x0000000000000000
0x00007fff60e8d948│+0x0010: 0x0000000000000000
0x00007fff60e8d950│+0x0018: 0x00007fff60e8d960 → 0x00007fff60e8d990 → 0x00007fff60e8d9b0 → 0x00007fff60e8da30 → 0x00007fff60e8db80 → 0x00007fff60e8dbb0 → 0x00007fff60e8dc30
0x00007fff60e8d958│+0x0020: 0x000072fb51420b80 → 0x000072fb51420b80 → [loop detected]
0x00007fff60e8d960│+0x0028: 0x00007fff60e8d990 → 0x00007fff60e8d9b0 → 0x00007fff60e8da30 → 0x00007fff60e8db80 → 0x00007fff60e8dbb0 → 0x00007fff60e8dc30 → 0x00007fff60e8dc70
0x00007fff60e8d968│+0x0030: 0x000072fb512f9b18 → 0x00005cb3cdd865b0 → 0x000072f9ec003f50 → 0x000072f9ec004a60 → 0x000072f9ec005850 → 0x00005cb3d61ae360 → 0x00005cb3dc62d3a0
0x00007fff60e8d970│+0x0038: 0x00007fff60e8d990 → 0x00007fff60e8d9b0 → 0x00007fff60e8da30 → 0x00007fff60e8db80 → 0x00007fff60e8dbb0 → 0x00007fff60e8dc30 → 0x00007fff60e8dc70 ← $rbp
────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── code:x86:64 ────
0x72fb50cade16 mov r9, QWORD PTR [rsp+0x10]
0x72fb50cade1b mov QWORD PTR [rsp+0x8], r11
0x72fb50cade20 syscall
→ 0x72fb50cade22 ret
↳ 0x72fb50ca1fda mov r11, QWORD PTR [rbp-0x18]
0x72fb50ca1fde mov edx, DWORD PTR [r11+0x308]
0x72fb50ca1fe5 pop rcx
0x72fb50ca1fe6 pop rsi
0x72fb50ca1fe7 cmp rax, 0xfffffffffffffffc
0x72fb50ca1feb jne 0x72fb50ca2006
────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── threads ────
[#0] Id 29, Name: "cuda-EvtHandlr", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#1] Id 10, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#2] Id 28, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#3] Id 27, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#4] Id 26, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#5] Id 24, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#6] Id 1, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#7] Id 20, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#8] Id 19, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#9] Id 17, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#10] Id 4, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#11] Id 16, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#12] Id 15, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#13] Id 18, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#14] Id 14, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#15] Id 7, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#16] Id 22, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#17] Id 2, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#18] Id 21, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#19] Id 6, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#20] Id 9, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#21] Id 23, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#22] Id 13, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#23] Id 5, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#24] Id 8, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#25] Id 25, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#26] Id 3, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#27] Id 11, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#28] Id 12, Name: "python", stopped 0x72fb50d26eed in syscall (), reason: STOPPED
[#29] Id 30, Name: "python", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
[#30] Id 31, Name: "cuda00001800007", stopped 0x72fb50cade22 in ?? (), reason: STOPPED
──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── trace ────
[#0] 0x72fb50cade22 → ret
[#1] 0x72fb50ca1fda → mov r11, QWORD PTR [rbp-0x18]
[#2] 0x72fb50ca2024 → pop rdx
[#3] 0x72fb50d29475 → epoll_wait()
[#4] 0x72fb4ffef584 → mov rdi, rbx
[#5] 0x72fb51069189 → _PyEval_EvalFrameDefault()
[#6] 0x72fb510702a6 → mov r13, rax
[#7] 0x72fb5107035a → PyEval_EvalCode()
[#8] 0x72fb51073cd4 → test rax, rax
[#9] 0x72fb51073dcc → sub QWORD PTR [rbx], 0x1
───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
#0 0x000072fb50cade22 in ?? () from /usr/lib/libc.so.6
#1 0x000072fb50ca1fda in ?? () from /usr/lib/libc.so.6
#2 0x000072fb50ca2024 in ?? () from /usr/lib/libc.so.6
#3 0x000072fb50d29475 in epoll_wait () from /usr/lib/libc.so.6
#4 0x000072fb4ffef584 in ?? () from /usr/lib/python3.11/lib-dynload/select.cpython-311-x86_64-linux-gnu.so
#5 0x000072fb51069189 in _PyEval_EvalFrameDefault () from /usr/lib/libpython3.11.so.1.0
#6 0x000072fb510702a6 in ?? () from /usr/lib/libpython3.11.so.1.0
#7 0x000072fb5107035a in PyEval_EvalCode () from /usr/lib/libpython3.11.so.1.0
#8 0x000072fb51073cd4 in ?? () from /usr/lib/libpython3.11.so.1.0
#9 0x000072fb51073dcc in ?? () from /usr/lib/libpython3.11.so.1.0
#10 0x000072fb51073ed9 in ?? () from /usr/lib/libpython3.11.so.1.0
#11 0x000072fb51093ec7 in _PyRun_SimpleFileObject () from /usr/lib/libpython3.11.so.1.0
#12 0x000072fb51094589 in _PyRun_AnyFileObject () from /usr/lib/libpython3.11.so.1.0
#13 0x000072fb5109576a in Py_RunMain () from /usr/lib/libpython3.11.so.1.0
#14 0x000072fb50c376b5 in ?? () from /usr/lib/libc.so.6
#15 0x000072fb50c37769 in __libc_start_main () from /usr/lib/libc.so.6
#16 0x00005cb3c1b03055 in _start ()
[Inferior 1 (process 55350) detached]
terminate called after throwing an instance of 'nvinfer1::APIUsageError'
what(): CUDA initialization failure with error: 35. Please check your CUDA installation: http://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html In checkCudaInstalledAndPrintMemoryUsage at optimizer/api/builder.cpp:1238