Tokenizer alignment code

[jxmorris12]

Hi, I don't see any code in the repository for performing alignment between tokenizers. It would be really helpful if you could share this portion of your code.

[liujiaheng]

I have the same question. Could you share the alignment code?