Skip to content

Commit a67ecfa

Browse files
diliu0349yangw-dev
authored andcommitted
[DOC] fix doc typos (vllm-project#19600)
Signed-off-by: Di Liu <liu-di@sjtu.edu.cn> Signed-off-by: Yang Wang <elainewy@meta.com>
1 parent 860bd12 commit a67ecfa

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

vllm/model_executor/layers/vocab_parallel_embedding.py

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -176,17 +176,17 @@ class VocabParallelEmbedding(torch.nn.Module):
176176
Therefore, the tensor format looks like the following:
177177
TP1, rank 0 (no sharding):
178178
|< --------BASE-------- >|< -BASE PADDING-- >|< -----LORA------ >|< -LORA PADDING-- >|
179-
corresponding token_id: | 0 | 1 | ... | 1009 | -1 | ... | -1 | 1010 | ... | 1015 | -1 | ... | -1 |
179+
corresponding token_id: | 0 | 1 | ... | 1009 | -1 | ... | -1 | 1010 | ... | 1025 | -1 | ... | -1 |
180180
index: | 0 | 1 | ... | 1009 | 1010 | ... | 1023 | 1024 | ... | 1039 | 1040 | ... | 1087 |
181181
182182
TP2, rank 0:
183183
|< --------------------BASE--------------------- >|< -----LORA------ >|< -LORA PADDING- >|
184-
corresponding token_id: | 0 | 1 | 2 | ... | 497 | 498 | ... | 511 | 1000 | ... | 1015 | -1 | ... | -1 |
185-
index: | 0 | 1 | 2 | ... | 497 | 498 | ... | 511 | 512 | ... | 527 | 520 | ... | 543 |
184+
corresponding token_id: | 0 | 1 | 2 | ... | 497 | 498 | ... | 511 | 1010 | ... | 1025 | -1 | ... | -1 |
185+
index: | 0 | 1 | 2 | ... | 497 | 498 | ... | 511 | 512 | ... | 527 | 528 | ... | 543 |
186186
TP2, rank 1:
187187
|< -----------BASE----------- >|< -BASE PADDING- >|< -----------LORA PADDING----------- >|
188188
corresponding token_id: | 512 | 513 | 514 | ... | 1009 | -1 | ... | -1 | -1 | ... | -1 | -1 | ... | -1 |
189-
index: | 0 | 1 | 2 | ... | 497 | 498 | ... | 511 | 512 | ... | 519 | 520 | ... | 543 |
189+
index: | 0 | 1 | 2 | ... | 497 | 498 | ... | 511 | 512 | ... | 527 | 528 | ... | 543 |
190190
191191
Args:
192192
num_embeddings: vocabulary size.

0 commit comments

Comments
 (0)