Heads-up, Zephyr doesn't use special tokens for its prompt template.

[staviq]

Almost as if there was not enough confusion already, Zephyr prompt template does not appear to use special tokens, despite introducing chat tags.

It's vocab does not contain tokens for "<|user|>", "<|assistant|>" or "<|system|>".

And those tags do show up in the conversation because they don't have special tokens representing them.

While confusing, this does appear to be "correct" according to the original model source files on HF.