Infrared-LLaVA: Enhancing Understanding of Infrared Images in Multi-Modal Large Language Models

Shixin Jiang^1∗, Zerui Chen¹, Jiafeng Liang¹, Yanyan Zhao¹, Ming Liu^1,2†, Bing Qin^1,2

¹Harbin Institute of Technology, Harbin, China

²Peng Cheng Laboratory, Shenzhen, China

This repository contains the resources for EMNLP2024 paper Infrared-LLaVA: Enhancing Understanding of Infrared Images in Multi-Modal Large Language Models

For more details, please refer to the paper: Infrared-LLaVA: Enhancing Understanding of Infrared Images in Multi-Modal Large Language Models.

🎉 Updates

• 2025/04/19 We have updated our dataset.
• 2024/09/22 Our paper is accepted by EMNLP2024 Finding.

Dataset

• Infrared-Images
• Infrared-Pretrain-500k
• Infrared-Instruct-12k

Benchmark

• Infrared-Benchmark