Skip to content

Commit 8240833

Browse files
committed
fix lint error
Signed-off-by: XingXing Qiao <qiaoxx@dingdao.com>
1 parent ad896fa commit 8240833

File tree

1 file changed

+0
-2
lines changed

1 file changed

+0
-2
lines changed

convert-hf-to-gguf.py

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2741,8 +2741,6 @@ def set_vocab(self):
27412741
vocab_size = hparams.get("padded_vocab_size", len(tokenizer.get_vocab()))
27422742
assert max(tokenizer.get_vocab().values()) < vocab_size
27432743

2744-
reverse_vocab = {id_: encoded_tok for encoded_tok, id_ in tokenizer.get_vocab().items()}
2745-
27462744
for token_id in range(vocab_size):
27472745
piece = tokenizer._convert_id_to_token(token_id)
27482746
if token_id == 0:

0 commit comments

Comments
 (0)