WSL2: CUDA is detected, but using it failed

[driwand]

Hello!

Using the latest WSL2 version along with NVIDIA's latest driver and I installed CUDA following this guide.

I ran the following the command npx --no node-llama-cpp inspect gpu but here is my error output:

OS: Ubuntu 20.04.6 LTS (x64)
Node: 22.3.0 (x64)
TypeScript: 5.6.3
node-llama-cpp: 3.2.0

Error: /lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.29' not found (required by node_modules/@node-llama-cpp/linux-x64-cuda/bins/linux-x64-cuda/llama-addon.node)
    at Module._extensions..node (node:internal/modules/cjs/loader:1570:18)
    at Module.load (node:internal/modules/cjs/loader:1275:32)
    at Module._load (node:internal/modules/cjs/loader:1091:12)
    at wrapModuleLoad (node:internal/modules/cjs/loader:212:19)
    at Module.require (node:internal/modules/cjs/loader:1297:12)
    at require (node:internal/modules/helpers:123:16)
    at process.<anonymous> (file:/ node_modules/node-llama-cpp/dist/bindings/utils/testBindingBinary.js:83:33)
    at process.emit (node:events:520:28)
    at emit (node:internal/child_process:951:14)
    at process.processTicksAndRejections (node:internal/process/task_queues:83:21) {
  code: 'ERR_DLOPEN_FAILED'
}
CUDA: CUDA is detected, but using it failed
To resolve errors related to CUDA, see the CUDA guide: https://node-llama-cpp.withcat.ai/guide/CUDA
Error: /lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.29' not found (required by node_modules/@node-llama-cpp/linux-x64-vulkan/bins/linux-x64-vulkan/llama-addon.node)
    at Module._extensions..node (node:internal/modules/cjs/loader:1570:18)
    at Module.load (node:internal/modules/cjs/loader:1275:32)
    at Module._load (node:internal/modules/cjs/loader:1091:12)
    at wrapModuleLoad (node:internal/modules/cjs/loader:212:19)
    at Module.require (node:internal/modules/cjs/loader:1297:12)
    at require (node:internal/modules/helpers:123:16)
    at process.<anonymous> (file:/ node_modules/node-llama-cpp/dist/bindings/utils/testBindingBinary.js:83:33)
    at process.emit (node:events:520:28)
    at emit (node:internal/child_process:951:14)
    at process.processTicksAndRejections (node:internal/process/task_queues:83:21) {
  code: 'ERR_DLOPEN_FAILED'
}
Vulkan: Vulkan is detected, but using it failed
To resolve errors related to Vulkan, see the Vulkan guide: https://node-llama-cpp.withcat.ai/guide/vulkan

CPU model: AMD Ryzen 5 5600H with Radeon Graphics
Math cores: 6
Used RAM: 29.75% (1.99GB/6.7GB)
Free RAM: 70.24% (4.71GB/6.7GB)
Used swap: 0% (0B/2GB)
Max swap size: 2GB

nvidia-smi output is the following:

+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 565.57.02              Driver Version: 566.03         CUDA Version: 12.7     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 3050 ...    On  |   00000000:01:00.0 Off |                  N/A |
| N/A   41C    P8              6W /   85W |       2MiB /   4096MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
                                                                                         
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|    0   N/A  N/A       237      C   /ollama                                     N/A      |
+-----------------------------------------------------------------------------------------+

Any ideas on how to solve this? thanks!

[driwand]

After getting GLIBCXX_3.4.29 I got the same error for GLIBC_2.34 not being found. It wasn't recommended to upgrade glib manually so I upgraded my WSL ubuntu from 20 to 22.04 and it solved my issue.