File tree Expand file tree Collapse file tree 3 files changed +26
-2
lines changed Expand file tree Collapse file tree 3 files changed +26
-2
lines changed Original file line number Diff line number Diff line change @@ -26,6 +26,15 @@ pip install -r requirements.txt
26
26
python setup_env.py --hf-repo HF1BitLLM/Llama3-8B-1.58-100B-tokens -q i2_s # only needs gen_code()
27
27
```
28
28
29
+ ## Roadmap
30
+
31
+ - [ ] minimize crate size
32
+ - [ ] rewrite sampler
33
+ - [ ] look into Metal implementation of MatMul kernerls for BitNet
34
+ - [ ] add more examples
35
+ - [ ] replace all remaining python from BitNet repo
36
+ - [ ] add better division between ` arm64 ` and ` x86_64 `
37
+
29
38
## Thanks
30
39
31
40
Heavily inspired by [ llama-cpp-rs] ( https://github.com/utilityai/llama-cpp-rs )
Original file line number Diff line number Diff line change @@ -12,7 +12,10 @@ include = [
12
12
" build.rs" ,
13
13
" /src" ,
14
14
15
- " /bitnet" ,
15
+ " /bitnet/src" ,
16
+ " /bitnet/include" ,
17
+ " /bitnet/preset_kernels" ,
18
+ " /bitnet/utils" ,
16
19
" /bitnet/**/CMakeLists.txt" ,
17
20
18
21
" /bitnet/3rdparty/llama.cpp/common/*.h" ,
Original file line number Diff line number Diff line change 1
1
# bitnet-cpp
2
2
3
- A wrapper around the [ bitnet-cpp] ( https://github.com/microsoft/BitNet ) library for rust.
3
+ Almost safe wrapper for [ BitNet-cpp] ( https://github.com/microsoft/BitNet ) based on [ llama-cpp] ( https://github.com/ggerganov/llama.cpp )
4
+
5
+ ## Thanks
6
+
7
+ Heavily inspired by [ llama-cpp-rs] ( https://github.com/utilityai/llama-cpp-rs )
8
+
9
+ ## License
10
+
11
+ [ MIT] ( /LICENSE )
12
+
13
+ ## Copyright
14
+
15
+ © 2024, Eugene Hauptmann
You can’t perform that action at this time.
0 commit comments