Skip to content

Issues: bitsandbytes-foundation/bitsandbytes

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

183 Open 963 Closed
183 Open 963 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Cuda 12.9 support CUDA Setup Proposing to Close Question Further information is requested Windows
#1642 opened May 18, 2025 by MLConvexAI
@matthewdouglas
4
keep get Error while "python -m bitsandbytes" Question Further information is requested Windows
#1641 opened May 18, 2025 by dayu0532
@matthewdouglas
3
CPU/XPU tests align Cross Platform Intel Integration Question Further information is requested
#1637 opened May 13, 2025 by jiqing-feng
@matthewdouglas
2
Can't get llm_int8_skip_modules to work: 'Parameter' object has no attribute 'SCB'
#1634 opened May 12, 2025 by redbrain
illegal memory access with FSDP2 and AdamW8bit Contributions Welcome We welcome contributions to fix this issue! FSDP Optimizers Issues or feature requests relating to optimizers
#1633 opened May 11, 2025 by llllvvuu
1
[Bug]Low GLIBC limits bitsandbytes to 0.42.0 (causing Triton issues), while source-compiled newer bitsandbytes lacks __version__ attribute Build Dependencies Likely Not a BNB Issue
#1632 opened May 11, 2025 by notlu
5
None of the available devices are supported by bitandbytes Likely Not a BNB Issue Proposing to Close Waiting for Info Windows
#1627 opened May 7, 2025 by Fbarrade
1
Got this issue after starting trainer - def replace_unet_modules(unet: diffusers.models.unet_2d_condition.UNet2DConditionModel, mem_eff_attn, xformers):
#1624 opened May 6, 2025 by khakachang
CUDA Setup failed despite GPU being available. Dependencies Linux Proposing to Close
#1614 opened Apr 28, 2025 by WangStone1
5
Why is the gpu memory still occupied after deleting the model and calling torch.cuda.empty_cache() when using 4-bit quantization?
#1611 opened Apr 27, 2025 by situqingyun
How to get the information of which columns have been quantified?
#1609 opened Apr 25, 2025 by huangdiudiu
1
[AMD GPU installation] The Rocm-bitsandbytes installation issues ROCm
#1608 opened Apr 25, 2025 by haic0
1
Error while generating model using CUDA & auto1111sdk Proposing to Close Waiting for Info Windows
#1606 opened Apr 23, 2025 by raajeshk-2020
2
Phi 4 Multimodal not working with BnB/4bit quantization
#1600 opened Apr 16, 2025 by palladium123
Optimizer custom ops Cross Platform
#1595 opened Apr 15, 2025 by matthewdouglas v0.47.0
lib.cquantize_blockwise_fp32 mutates absmax
#1587 opened Apr 9, 2025 by cyr0930
1
Does it work for gemma3 4b Likely Not a BNB Issue Proposing to Close
#1572 opened Mar 25, 2025 by Oxi84
@matthewdouglas
3
All input tensors need to be on the same GPU, but found some tensors to not be on a GPU Windows
#1571 opened Mar 24, 2025 by SiRMHS
memory issue, prepare_model_for_kbit_training Likely Not a BNB Issue Question Further information is requested
#1569 opened Mar 19, 2025 by wenzhifang
3
CUDA Setup failed despite GPU being available. what's wrrong? CUDA Setup Windows
#1568 opened Mar 17, 2025 by yoogon20
@matthewdouglas
7
CUDA Setup failed despite GPU being available. CUDA Setup
#1559 opened Mar 8, 2025 by dvShilenko
3
[chore] fix continuous release not working correctly Chore
#1558 opened Mar 6, 2025 by Titus-von-Koeller
3 tasks
@Titus-von-Koeller
2
Increased VRAM consumption when coupled with DDP
#1555 opened Mar 4, 2025 by TParcollet
Custom Ops: Unit Tests Cross Platform High Priority (first issues that will be worked on)
#1553 opened Mar 3, 2025 by matthewdouglas
5 tasks
v0.46.0
@matthewdouglas
[AMD ROCm] NotImplementedError: bnb_4bit_use_double_quant is not supported yet for CPU/XPU ROCm
#1551 opened Mar 2, 2025 by Looong01
1
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.