fatalError("Missing `sep` processor configuration" when using "facebook/bart-large-mnli"

[imranali123]

When loading tokenizer using AutoTokenizer it's crashing on this line.

swift-transformers/Sources/Tokenizers/PostProcessor.swift

Line 95 in 1d26ce0

guard let sep = config.sep?.tokenValue else { fatalError("Missing `sep` processor configuration") }

[FL33TW00D]

I can confirm I can replicate this.

facebook/bart-large-mnli does also appear to have a sep token in the configuration, just seems to not be picked up correctly in the config. @pcuenca @greenrazer

[FL33TW00D]

Should be fixed now as part of #188! Please report back if it is not!