@@ -25,13 +25,25 @@ bitsandbytes has the following minimum requirements for all platforms:
25
25
26
26
#### Accelerator support:
27
27
28
+ <small >Note: this table reflects the status of the current development branch. For the latest stable release, see the
29
+ [ document in the v0.46.0 tag] ( https://github.com/bitsandbytes-foundation/bitsandbytes/blob/0.46.0/README.md#accelerator-support ) .
30
+ </small >
31
+
32
+ ##### Legend:
33
+ 🚧 = In Development,
34
+ 〰️ = Partially Supported,
35
+ ✅ = Supported,
36
+ ❌ = Not Supported
37
+
28
38
<table >
29
39
<thead >
30
40
<tr>
31
41
<th>Platform</th>
32
42
<th>Accelerator</th>
33
43
<th>Hardware Requirements</th>
34
- <th>Support Status</th>
44
+ <th>LLM.int8()</th>
45
+ <th>QLoRA 4-bit</th>
46
+ <th>8-bit Optimizers</th>
35
47
</tr>
36
48
</thead >
37
49
<tbody >
@@ -42,13 +54,17 @@ bitsandbytes has the following minimum requirements for all platforms:
42
54
<td align="right">x86-64</td>
43
55
<td>◻️ CPU</td>
44
56
<td>AVX2</td>
45
- <td>〰️ Partial Support</td>
57
+ <td>〰️</td>
58
+ <td>〰️</td>
59
+ <td>❌</td>
46
60
</tr>
47
61
<tr>
48
62
<td></td>
49
63
<td>🟩 NVIDIA GPU <br><code>cuda</code></td>
50
64
<td>SM50+ minimum<br>SM75+ recommended</td>
51
- <td>✅ Full Support</td>
65
+ <td>✅</td>
66
+ <td>✅</td>
67
+ <td>✅</td>
52
68
</tr>
53
69
<tr>
54
70
<td></td>
@@ -57,7 +73,9 @@ bitsandbytes has the following minimum requirements for all platforms:
57
73
CDNA: gfx90a, gfx942<br>
58
74
RDNA: gfx1100, gfx1200
59
75
</td>
60
- <td>🚧 In Development</td>
76
+ <td>🚧</td>
77
+ <td>🚧</td>
78
+ <td>🚧</td>
61
79
</tr>
62
80
<tr>
63
81
<td></td>
@@ -67,25 +85,33 @@ bitsandbytes has the following minimum requirements for all platforms:
67
85
Arc A-Series (Alchemist)<br>
68
86
Arc B-Series (Battlemage)
69
87
</td>
70
- <td>🚧 In Development</td>
88
+ <td>🚧</td>
89
+ <td>🚧</td>
90
+ <td>🚧</td>
71
91
</tr>
72
92
<tr>
73
93
<td></td>
74
94
<td>🟪 Intel Gaudi <br><code>hpu</code></td>
75
95
<td>Gaudi1, Gaudi2, Gaudi3</td>
76
- <td>🚧 In Development</td>
96
+ <td>🚧</td>
97
+ <td>🚧</td>
98
+ <td>❌</td>
77
99
</tr>
78
100
<tr>
79
101
<td align="right">aarch64</td>
80
102
<td>◻️ CPU</td>
81
103
<td></td>
82
- <td>〰️ Partial Support</td>
104
+ <td>〰️</td>
105
+ <td>〰️</td>
106
+ <td>❌</td>
83
107
</tr>
84
108
<tr>
85
109
<td></td>
86
110
<td>🟩 NVIDIA GPU <br><code>cuda</code></td>
87
111
<td>SM75, SM80, SM90, SM100</td>
88
- <td>✅ Full Support</td>
112
+ <td>✅</td>
113
+ <td>✅</td>
114
+ <td>✅</td>
89
115
</tr>
90
116
<tr>
91
117
<td colspan="4">🪟 <strong>Windows 11 / Windows Server 2019+</strong></td>
@@ -94,13 +120,17 @@ bitsandbytes has the following minimum requirements for all platforms:
94
120
<td align="right">x86-64</td>
95
121
<td>◻️ CPU</td>
96
122
<td>AVX2</td>
97
- <td>〰️ Partial Support</td>
123
+ <td>〰️</td>
124
+ <td>〰️</td>
125
+ <td>❌</td>
98
126
</tr>
99
127
<tr>
100
128
<td></td>
101
129
<td>🟩 NVIDIA GPU <br><code>cuda</code></td>
102
130
<td>SM50+ minimum<br>SM75+ recommended</td>
103
- <td>✅ Full Support</td>
131
+ <td>✅</td>
132
+ <td>✅</td>
133
+ <td>✅</td>
104
134
</tr>
105
135
<tr>
106
136
<td></td>
@@ -109,7 +139,9 @@ bitsandbytes has the following minimum requirements for all platforms:
109
139
Arc A-Series (Alchemist) <br>
110
140
Arc B-Series (Battlemage)
111
141
</td>
112
- <td>🚧 In Development</td>
142
+ <td>🚧</td>
143
+ <td>🚧</td>
144
+ <td>🚧</td>
113
145
</tr>
114
146
<tr>
115
147
<td colspan="4">🍎 <strong>macOS 13.1+</strong></td>
@@ -118,13 +150,17 @@ bitsandbytes has the following minimum requirements for all platforms:
118
150
<td align="right">arm64</td>
119
151
<td>◻️ CPU</td>
120
152
<td>Apple M1+</td>
121
- <td>🚧 In Development</td>
153
+ <td>🚧</td>
154
+ <td>🚧</td>
155
+ <td>❌</td>
122
156
</tr>
123
157
<tr>
124
158
<td></td>
125
159
<td>⬜ Metal <br><code>mps</code></td>
126
160
<td>Apple M1+</td>
127
- <td>🚧 In Development</td>
161
+ <td>🚧</td>
162
+ <td>🚧</td>
163
+ <td>❌</td>
128
164
</tbody >
129
165
</table >
130
166
0 commit comments