Skip to content

Actions: pytorch-labs/tokenizers

Actions

trunk

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
trunk.yml
161 workflow runs
161 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Add support for more behavior in Split pretokenizer (#93) trunk #111: Commit 448fded pushed by larryliu0820
July 2, 2025 22:46 2m 23s main
main
July 2, 2025 22:46 2m 23s
Use a small tokenizer.json for unit test (#92) (#94) trunk #110: Commit f5896f8 pushed by larryliu0820
July 2, 2025 22:14 2m 51s main
main
July 2, 2025 22:14 2m 51s
Revert "[hf] Add new features to HF tokenizer" trunk #109: Pull request #90 opened by jackzhxng
July 2, 2025 16:34 2m 28s revert-87-gemma3
revert-87-gemma3
July 2, 2025 16:34 2m 28s
Revert "Add sentencepiece tokenizer support to llm runner" trunk #108: Pull request #89 opened by jackzhxng
July 2, 2025 03:54 1m 54s revert-85-export-D76789606
revert-85-export-D76789606
July 2, 2025 03:54 1m 54s
[hf] Add features to HF tokenizer (#87) trunk #107: Commit e894ef4 pushed by larryliu0820
June 26, 2025 04:02 3m 18s main
main
June 26, 2025 04:02 3m 18s
[hf] Add new features to HF tokenizer trunk #106: Pull request #87 opened by larryliu0820
June 26, 2025 03:39 3m 12s gemma3
gemma3
June 26, 2025 03:39 3m 12s
Add sentencepiece tokenizer support to llm runner trunk #105: Commit 6eb0839 pushed by facebook-github-bot
June 20, 2025 06:12 2m 37s main
main
June 20, 2025 06:12 2m 37s
Add sentencepiece tokenizer support to llm runner trunk #104: Pull request #85 synchronize by facebook-github-bot
June 19, 2025 08:48 1m 55s export-D76789606
export-D76789606
June 19, 2025 08:48 1m 55s
Add sentencepiece tokenizer support to llm runner trunk #103: Pull request #85 synchronize by facebook-github-bot
June 19, 2025 08:02 2m 49s export-D76789606
export-D76789606
June 19, 2025 08:02 2m 49s
Add sentencepiece tokenizer support to llm runner trunk #102: Pull request #85 synchronize by larryliu0820
June 17, 2025 21:35 1m 57s export-D76789606
export-D76789606
June 17, 2025 21:35 1m 57s
Add sentencepiece tokenizer support to llm runner trunk #101: Pull request #85 synchronize by larryliu0820
June 17, 2025 21:31 2m 13s export-D76789606
export-D76789606
June 17, 2025 21:31 2m 13s
Add sentencepiece tokenizer support to llm runner trunk #100: Pull request #85 synchronize by facebook-github-bot
June 17, 2025 21:28 1m 55s export-D76789606
export-D76789606
June 17, 2025 21:28 1m 55s
Consolidate TokenIndex definition (#84) trunk #99: Commit 4da2344 pushed by larryliu0820
June 17, 2025 03:46 2m 32s main
main
June 17, 2025 03:46 2m 32s
Enable install find package (#82) trunk #98: Commit 3d67b29 pushed by larryliu0820
June 12, 2025 21:18 2m 24s main
main
June 12, 2025 21:18 2m 24s
Enable install find package trunk #97: Pull request #82 synchronize by larryliu0820
June 12, 2025 21:11 2m 15s enable_install_find_package
enable_install_find_package
June 12, 2025 21:11 2m 15s
Enable install find package trunk #96: Pull request #82 opened by larryliu0820
June 10, 2025 21:20 2m 43s enable_install_find_package
enable_install_find_package
June 10, 2025 21:20 2m 43s
Fix cmake for regex lookahead (#80) trunk #95: Commit fc32028 pushed by jackzhxng
June 5, 2025 18:59 2m 39s main
main
June 5, 2025 18:59 2m 39s
Fix cmake for regex lookahead trunk #94: Pull request #80 synchronize by jackzhxng
June 5, 2025 18:39 19m 35s jz/fix-cmake
jz/fix-cmake
June 5, 2025 18:39 19m 35s
Fix cmake for regex lookahead trunk #93: Pull request #80 opened by jackzhxng
June 5, 2025 18:01 18m 41s jz/fix-cmake
jz/fix-cmake
June 5, 2025 18:01 18m 41s
Reland #66 and #67 trunk #92: Commit fc5962c pushed by facebook-github-bot
June 2, 2025 22:56 2m 36s main
main
June 2, 2025 22:56 2m 36s
Add regex unit tests and enable shared linkage in fbcode trunk #91: Commit ea21dc7 pushed by facebook-github-bot
May 29, 2025 01:30 2m 45s main
main
May 29, 2025 01:30 2m 45s
Use weak symbol create_fallback_regex to separate the implementation … trunk #90: Commit be07807 pushed by facebook-github-bot
May 22, 2025 19:56 2m 12s main
main
May 22, 2025 19:56 2m 12s
Use weak symbol create_fallback_regex to separate the implementation using PCRE2 and std::regex trunk #89: Pull request #77 synchronize by facebook-github-bot
May 22, 2025 00:49 2m 12s export-D75173102
export-D75173102
May 22, 2025 00:49 2m 12s
Add is_loaded() API trunk #88: Commit d261f58 pushed by facebook-github-bot
May 22, 2025 00:46 2m 42s main
main
May 22, 2025 00:46 2m 42s
Use weak symbol create_fallback_regex to separate the implementation using PCRE2 and std::regex trunk #87: Pull request #77 synchronize by facebook-github-bot
May 22, 2025 00:29 2m 53s export-D75173102
export-D75173102
May 22, 2025 00:29 2m 53s