Skip to content

Commit bd72d21

Browse files
authored
Make enable_disaggregation Argument Optional in DispatchKVCacheCreation (#3166)
* Fixed compatibility issue with TVM by removing unsupported 'enable_disaggregation' argument * Fix linting error: Use double quotes for string literal in kwargs.pop() * Make argument optional in
1 parent d128e59 commit bd72d21

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

python/mlc_llm/compiler_pass/dispatch_kv_cache_creation.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -152,6 +152,10 @@ def create_tir_paged_kv_cache(
152152
"support_sliding_window_", relax.ShapeStructInfo([kwargs["support_sliding_window"]])
153153
)
154154

155+
# Ensure 'enable_disaggregation' is optional
156+
enable_disaggregation = kwargs.pop("enable_disaggregation", False)
157+
kwargs["enable_disaggregation"] = enable_disaggregation
158+
155159
with bb.function(
156160
name="create_tir_paged_kv_cache",
157161
params=[

0 commit comments

Comments
 (0)