Skip to content

Commit 3474073

Browse files
authored
[3rdparty] Bump tokenizers-cpp for HuggingFace tokenizer update (#3029)
This PR bumps the 3rdparty tokenizers-cpp to update the HuggingFace tokenizers package dependency.
1 parent a9baa1f commit 3474073

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

0 commit comments

Comments
 (0)