Skip to content

Commit 332fa19

Browse files
authored
Update README.md
1 parent 3da7e32 commit 332fa19

File tree

1 file changed

+14
-1
lines changed

1 file changed

+14
-1
lines changed

README.md

Lines changed: 14 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,11 +1,24 @@
11
# llama-cpp-python cuBLAS wheels
22
Wheels for llama-cpp-python compiled with cuBLAS support.
33

4+
Currently, only includes 0.1.62 and 0.1.66.
5+
46
Requirements:
57
- Windows and Linux x86_64
68
- CUDA 11.6 - 12.1
79
- CPython 3.7 - 3.11
810

9-
-install instructions placeholder-
11+
Installation instructions:
12+
---
13+
To install, you can use this command:
14+
```
15+
python -m pip install llama-cpp-python==0.1.66+cu117 --find-links=https://jllllll.github.io/llama-cpp-python-cuBLAS-wheels/cu117
16+
```
17+
This will install llama-cpp-python 0.1.66 for CUDA 11.7. You can change both instances of `cu117` to change the CUDA version.
1018

19+
An example for installing 0.1.62 for CUDA 12.1:
20+
```
21+
python -m pip install llama-cpp-python==0.1.62+cu121 --find-links=https://jllllll.github.io/llama-cpp-python-cuBLAS-wheels/cu121
22+
```
23+
---
1124
### All wheels are compiled using GitHub Actions

0 commit comments

Comments
 (0)