You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
please haw i can modify the encoding part to fit the Arabic text.
You mentioned it in your code for tokenizer class (# Found this part online, modified the encoding part to fit the Arabic text)
Please can you publish or send to me the modifed version and thank you.