Skip to content

Commit 6ece776

Browse files
committed
[Core] Implement sleep/wake_up for SpecDecodeWorker
Signed-off-by: Kebe <mail@kebe7jun.com>
1 parent 359200f commit 6ece776

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

vllm/spec_decode/spec_decode_worker.py

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1290,6 +1290,12 @@ def stop_profile(self):
12901290
if isinstance(self.scorer_worker, WorkerBase):
12911291
self.scorer_worker.stop_profile()
12921292

1293+
def sleep(self, level=1):
1294+
self.proposer_worker.sleep(level)
1295+
1296+
def wake_up(self, tags: Optional[list[str]] = None) -> None:
1297+
self.proposer_worker.wake_up(tags)
1298+
12931299

12941300
def split_num_cache_blocks_evenly(scorer_cache_block_size_bytes: int,
12951301
proposer_cache_block_size_bytes: int,

0 commit comments

Comments
 (0)