Romanlens

This repository contains the code implementation for the paper:
"RomanLens: The Role Of Latent Romanization In Multilinguality In LLMs"

Folder Structure

llm_logit_lens

• Contains logit lens analysis.
• Includes comparison between translation into Native script vs Romanized script.

llm_activation_patching

• Contains activation patching experiments for further probing model behavior.

---

Citation

@article{saji2025romanlens,
  title={RomanLens: The Role Of Latent Romanization In Multilinguality In LLMs},
  author={Saji, Alan and Aktar Husain, Jaavid and Jayakumar, Thanmay and Dabre, Raj and Kunchukuttan, Anoop and Puduppully, Ratish},
  journal={arXiv e-prints},
  pages={arXiv--2502},
  year={2025}
}