File tree Expand file tree Collapse file tree 1 file changed +14
-1
lines changed Expand file tree Collapse file tree 1 file changed +14
-1
lines changed Original file line number Diff line number Diff line change 1
1
# llama-cpp-python cuBLAS wheels
2
2
Wheels for llama-cpp-python compiled with cuBLAS support.
3
3
4
+ Currently, only includes 0.1.62 and 0.1.66.
5
+
4
6
Requirements:
5
7
- Windows and Linux x86_64
6
8
- CUDA 11.6 - 12.1
7
9
- CPython 3.7 - 3.11
8
10
9
- -install instructions placeholder-
11
+ Installation instructions:
12
+ ---
13
+ To install, you can use this command:
14
+ ```
15
+ python -m pip install llama-cpp-python==0.1.66+cu117 --find-links=https://jllllll.github.io/llama-cpp-python-cuBLAS-wheels/cu117
16
+ ```
17
+ This will install llama-cpp-python 0.1.66 for CUDA 11.7. You can change both instances of ` cu117 ` to change the CUDA version.
10
18
19
+ An example for installing 0.1.62 for CUDA 12.1:
20
+ ```
21
+ python -m pip install llama-cpp-python==0.1.62+cu121 --find-links=https://jllllll.github.io/llama-cpp-python-cuBLAS-wheels/cu121
22
+ ```
23
+ ---
11
24
### All wheels are compiled using GitHub Actions
You can’t perform that action at this time.
0 commit comments