Skip to content

Commit d556cec

Browse files
committed
updated README
1 parent e53da59 commit d556cec

File tree

3 files changed

+26
-2
lines changed

3 files changed

+26
-2
lines changed

README.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -26,6 +26,15 @@ pip install -r requirements.txt
2626
python setup_env.py --hf-repo HF1BitLLM/Llama3-8B-1.58-100B-tokens -q i2_s # only needs gen_code()
2727
```
2828

29+
## Roadmap
30+
31+
- [ ] minimize crate size
32+
- [ ] rewrite sampler
33+
- [ ] look into Metal implementation of MatMul kernerls for BitNet
34+
- [ ] add more examples
35+
- [ ] replace all remaining python from BitNet repo
36+
- [ ] add better division between `arm64` and `x86_64`
37+
2938
## Thanks
3039

3140
Heavily inspired by [llama-cpp-rs](https://github.com/utilityai/llama-cpp-rs)

bitnet-cpp-sys/Cargo.toml

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,10 @@ include = [
1212
"build.rs",
1313
"/src",
1414

15-
"/bitnet",
15+
"/bitnet/src",
16+
"/bitnet/include",
17+
"/bitnet/preset_kernels",
18+
"/bitnet/utils",
1619
"/bitnet/**/CMakeLists.txt",
1720

1821
"/bitnet/3rdparty/llama.cpp/common/*.h",

bitnet-cpp/README.md

Lines changed: 13 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,15 @@
11
# bitnet-cpp
22

3-
A wrapper around the [bitnet-cpp](https://github.com/microsoft/BitNet) library for rust.
3+
Almost safe wrapper for [BitNet-cpp](https://github.com/microsoft/BitNet) based on [llama-cpp](https://github.com/ggerganov/llama.cpp)
4+
5+
## Thanks
6+
7+
Heavily inspired by [llama-cpp-rs](https://github.com/utilityai/llama-cpp-rs)
8+
9+
## License
10+
11+
[MIT](/LICENSE)
12+
13+
## Copyright
14+
15+
© 2024, Eugene Hauptmann

0 commit comments

Comments
 (0)