File tree Expand file tree Collapse file tree 2 files changed +12
-1
lines changed
vllm/model_executor/models Expand file tree Collapse file tree 2 files changed +12
-1
lines changed Original file line number Diff line number Diff line change @@ -819,7 +819,7 @@ Each [PromptUpdate][vllm.multimodal.processing.PromptUpdate] instance specifies
819
819
After you have defined [ BaseProcessingInfo] [ vllm.multimodal.processing.BaseProcessingInfo ] (Step 2),
820
820
[ BaseDummyInputsBuilder] [ vllm.multimodal.profiling.BaseDummyInputsBuilder ] (Step 3),
821
821
and [ BaseMultiModalProcessor] [ vllm.multimodal.processing.BaseMultiModalProcessor ] (Step 4),
822
- decorate the model class with {meth} ` MULTIMODAL_REGISTRY.register_processor < vllm.multimodal.registry .MultiModalRegistry.register_processor> `
822
+ decorate the model class with [ MULTIMODAL_REGISTRY.register_processor] [ vllm.multimodal.processing .MultiModalRegistry.register_processor ]
823
823
to register them to the multi-modal registry:
824
824
825
825
``` diff
Original file line number Diff line number Diff line change @@ -89,11 +89,22 @@ def get_input_embeddings(
89
89
) -> Tensor :
90
90
...
91
91
92
+ # TODO: Remove this overload once v0 is deprecated
92
93
@overload
93
94
def get_input_embeddings (
94
95
self ,
95
96
input_ids : Tensor ,
96
97
multimodal_embeddings : Optional [MultiModalEmbeddings ] = None ,
98
+ ) -> Tensor :
99
+ ...
100
+
101
+ def get_input_embeddings (
102
+ self ,
103
+ input_ids : Tensor ,
104
+ multimodal_embeddings : Optional [MultiModalEmbeddings ] = None ,
105
+ # Only necessary so that the v0 overload is valid
106
+ # TODO: Remove attn_metadata once v0 is deprecated
107
+ attn_metadata : Optional ["AttentionMetadata" ] = None ,
97
108
) -> Tensor :
98
109
"""
99
110
Returns the input embeddings merged from the text embeddings from
You can’t perform that action at this time.
0 commit comments