Search results

Phi 4 Multimodal not working with BnB/4bit quantization

Model SupportRelated to a specific modeling situation.Related to a specific modeling situation.

Status: Open.

#1600 In bitsandbytes-foundation/bitsandbytes;

· palladium123 opened on Apr 16, 2025

The output logistics of Qwen-7B under 8-bit quantization contain NaN

Model SupportRelated to a specific modeling situation.Related to a specific modeling situation.

Proposing to Close

Waiting for Info

Status: Open.

#1504 In bitsandbytes-foundation/bitsandbytes;

· Kairong-Han opened on Feb 9, 2025

Cannot load pre-quantized Janus Pro 7B

BugSomething isn't workingSomething isn't working

Medium Priority(will be worked on after all high priority issues)(will be worked on after all high priority issues)

Medium RiskRisk of bugs in transformers and other librariesRisk of bugs in transformers and other libraries

Model SupportRelated to a specific modeling situation.Related to a specific modeling situation.

Status: Open.

Bug

#1498 In bitsandbytes-foundation/bitsandbytes;

· neilmehta24 opened on Jan 30, 2025

Model support for OmniGen-v1

Model SupportRelated to a specific modeling situation.Related to a specific modeling situation.

Waiting for Info

Status: Open.

Feature

#1407 In bitsandbytes-foundation/bitsandbytes;

· Qarqor5555555 opened on Nov 1, 2024

Cannot load decoder.lm_head.weight when loading 4 bit quantized model using VisionEncoderDecoder.from_pretrained

Model SupportRelated to a specific modeling situation.Related to a specific modeling situation.

Status: Open.

#1343 In bitsandbytes-foundation/bitsandbytes;

· AditiJain14 opened on Aug 30, 2024

Quantized model using load_in_8bit produces very different results on T4 vs V100 GPU on Colab

Model SupportRelated to a specific modeling situation.Related to a specific modeling situation.

Status: Open.

#1186 In bitsandbytes-foundation/bitsandbytes;

· cjiangz opened on Apr 21, 2024

DBRX Support

Contributions WelcomeWe welcome contributions to fix this issue!We welcome contributions to fix this issue!

Model SupportRelated to a specific modeling situation.Related to a specific modeling situation.

Status: Open.

Feature

#1155 In bitsandbytes-foundation/bitsandbytes;

· maziyarpanahi opened on Mar 28, 2024