Code

Added RobertaTokenizer#188

Code

Merged

FL33TW00D merged 3 commits intohuggingface:mainhuggingface/swift-transformers:mainfrom

jkrukowski:roberta-tokenizerjkrukowski/swift-transformers:roberta-tokenizerCopy head branch name to clipboard

Mar 27, 2025

Commits

Commits on Mar 6, 2025

• Added RobertaTokenizer

  jkrukowski

  committed
  207aa94

  Copy full SHA for 207aa94

Commits on Mar 12, 2025

• Made parsing more restrictive, fixed tests

  jkrukowski

  committed
  52f9c42

  Copy full SHA for 52f9c42

Commits on Mar 25, 2025

• Resolved conflicts

  jkrukowski

  committed
  841ab58

  Copy full SHA for 841ab58