Rework emoji tokenizer to match Rust #56
Description
Current implementation is extremely sloppy. rust-unic/unic-emoji-char as in rust-lang/rust#88781 is likely a much better idea 🤔
{{ message }}
Current implementation is extremely sloppy. rust-unic/unic-emoji-char as in rust-lang/rust#88781 is likely a much better idea 🤔