Skip to content

Commit 0fd7926

Browse files
committed
Update README.md
1 parent 376e35e commit 0fd7926

File tree

1 file changed

+10
-3
lines changed

1 file changed

+10
-3
lines changed

README.md

Lines changed: 10 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,13 @@
11
# llama-cpp-python cuBLAS wheels
22
Wheels for [llama-cpp-python](https://github.com/abetlen/llama-cpp-python) compiled with cuBLAS support.
33

4-
Includes 0.1.62, 0.1.66, 0.1.67, 0.1.68, 0.1.69, 0.1.70, 0.1.71, 0.1.72, 0.1.73 and 0.1.74.
5-
64
Requirements:
75
- Windows and Linux x86_64
86
- CPU with support for AVX, AVX2 or AVX512
97
- CUDA 11.6 - 12.2
108
- CPython 3.7 - 3.11
11-
- Experimental Windows ROCm build for AMD GPUs: https://github.com/jllllll/llama-cpp-python-cuBLAS-wheels/releases/tag/rocm
9+
10+
Experimental Windows ROCm build for AMD GPUs: https://github.com/jllllll/llama-cpp-python-cuBLAS-wheels/releases/tag/rocm
1211

1312
Installation instructions:
1413
---
@@ -19,10 +18,18 @@ python -m pip install llama-cpp-python --prefer-binary --extra-index-url=https:/
1918
This will install the latest llama-cpp-python version available from here for CUDA 11.7. You can change `cu117` to change the CUDA version.
2019
You can also change `AVX2` to `AVX` or `AVX512` based on what your CPU supports.
2120

21+
You can install a specific version with:
22+
```
23+
python -m pip install llama-cpp-python==<version> --prefer-binary --extra-index-url=https://jllllll.github.io/llama-cpp-python-cuBLAS-wheels/AVX2/cu117
24+
```
2225
An example for installing 0.1.62 for CUDA 12.1 on a CPU without AVX2 support:
2326
```
2427
python -m pip install llama-cpp-python==0.1.62 --prefer-binary --extra-index-url=https://jllllll.github.io/llama-cpp-python-cuBLAS-wheels/AVX/cu121
2528
```
29+
List of available versions:
30+
```
31+
python -m pip index versions llama-cpp-python --index-url=https://jllllll.github.io/llama-cpp-python-cuBLAS-wheels/AVX2/cu117
32+
```
2633

2734
If you are replacing an already existing installation, you may need to uninstall that version before running the command above.
2835
You can also replace the existing version in one command like so:

0 commit comments

Comments
 (0)