You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi,friends.
here is the error and my platform info
Error: "TensorRT-LLM is not installed. Please install TensorRT-LLM or set TRTLLM_PLUGINS_PATH to the directory containing libnvinfer_plugin_tensorrt_llm.so to use converters for torch.distributed ops"
Platform:
Python Version: CPython 3.11.13
Operating System: Windows 10
CPU Architecture: AMD64
Driver Version: 580.88
CUDA Version: 13.0
and i notice that most version of tensorrt-llm support linux.
so how can i speed up the program.using virtual platform of linux or there's other ways to install tensorrt-llm on windows.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hi,friends.
here is the error and my platform info
Error: "TensorRT-LLM is not installed. Please install TensorRT-LLM or set TRTLLM_PLUGINS_PATH to the directory containing libnvinfer_plugin_tensorrt_llm.so to use converters for torch.distributed ops"
Platform:
Python Version: CPython 3.11.13
Operating System: Windows 10
CPU Architecture: AMD64
Driver Version: 580.88
CUDA Version: 13.0
and i notice that most version of tensorrt-llm support linux.
so how can i speed up the program.using virtual platform of linux or there's other ways to install tensorrt-llm on windows.
Beta Was this translation helpful? Give feedback.
All reactions