Skip to content

Commit 8062650

Browse files
committed
llama : fix simple splits when the batch contains embeddings
1 parent 80d9d2a commit 8062650

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/llama.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2818,7 +2818,7 @@ struct llama_sbatch {
28182818
}
28192819
} else {
28202820
// simple split
2821-
ubatch.embd = batch->embd + seq.offset;
2821+
ubatch.embd = batch->embd + (n_embd * seq.offset);
28222822
}
28232823
} else {
28242824
ubatch.embd = nullptr;

0 commit comments

Comments
 (0)