Skip to content

Commit cbbcd88

Browse files
committed
feat: Update llama.cpp
1 parent 19234aa commit cbbcd88

File tree

4 files changed

+54
-144
lines changed

4 files changed

+54
-144
lines changed

llama_cpp/_internals.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -291,7 +291,7 @@ def kv_cache_seq_keep(self, seq_id: int):
291291

292292
def kv_cache_seq_shift(self, seq_id: int, p0: int, p1: int, shift: int):
293293
assert self.ctx is not None
294-
llama_cpp.llama_kv_cache_seq_shift(self.ctx, seq_id, p0, p1, shift)
294+
llama_cpp.llama_kv_cache_seq_add(self.ctx, seq_id, p0, p1, shift)
295295

296296
def get_state_size(self) -> int:
297297
assert self.ctx is not None

0 commit comments

Comments
 (0)