Skip to content

Commit 9de5225

Browse files
quanliu1991刘全
authored andcommitted
[Core] add remove_seq_from_computed_blocks_tracker to BlockSpaceManager (vllm-project#19686)
Signed-off-by: 刘全 <quan.liu2@dbappsecurity.com.cn> Co-authored-by: 刘全 <quan.liu2@dbappsecurity.com.cn> Signed-off-by: minpeter <kali2005611@gmail.com>
1 parent 9c0977d commit 9de5225

File tree

2 files changed

+7
-0
lines changed

2 files changed

+7
-0
lines changed

vllm/core/interfaces.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -133,3 +133,7 @@ def reset_prefix_cache(self, device: Optional[Device] = None) -> bool:
133133
@abstractmethod
134134
def get_num_cached_tokens(self, seq: Sequence) -> int:
135135
pass
136+
137+
@abstractmethod
138+
def remove_seq_from_computed_blocks_tracker(self, seq: Sequence) -> None:
139+
pass

vllm/core/placeholder_block_space_manager.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -98,3 +98,6 @@ def reset_prefix_cache(self, device: Optional[Device] = None) -> bool:
9898

9999
def get_num_cached_tokens(self, seq: Sequence) -> int:
100100
return 0
101+
102+
def remove_seq_from_computed_blocks_tracker(self, seq: Sequence) -> None:
103+
return

0 commit comments

Comments
 (0)