Awesome-Multimodel-learning

🌐 Awesome Multimodal Learning & Foundation Models

📚 A curated collection of resources related to Multimodal Learning and Multimodal Foundation Models, including applications in healthcare, vision-language modeling, tutorials, and open-source tools.

---

📌 Table of Contents

• 🧠 Tutorials & Workshops
• 🏛 Research Labs
• 📊 Applications in Healthcare
• 🧰 Code & Tools
• 📚 Suggested Papers
• 🤝 Contributing

---

🧠 Tutorials & Workshops

• 🎓 CVPR 2024 Multimodal LLM Workshop
• 🎓 ICML 2023 Tutorial on Multimodal Machine Learning

---

🏛 Research Labs

• 🏫 CMU Multicomp Lab (Homepage)
• 🔬 CMU Multicomp Research Projects
• 🧩 CMU Multimodal Machine Learning Portal
• 💻 CMU Multicomp GitHub

---

📊 Applications in Healthcare

• 🧠 Google Research – Multimodal Medical AI
• 🩺 Owkin: A–Z of AI in Healthcare
• 🔬 Owkin – Multimodal Data in Healthcare

---

🧰 Code & Tools

• 🔗 CMU MultiComp GitHub
• 🤖 OpenFlamingo
• 🧠 LLaVA (Large Language and Vision Assistant)
• 📦 BLIP / BLIP-2 (Salesforce)
• 🛠 HuggingFace Transformers – Multimodal Support

---

📚 Suggested Papers

Title	Year	Link
Multimodal Transformers: A Survey	2022	arXiv
A Survey on Multimodal Learning	2023	arXiv
A Survey on Multimodal Foundation Models	2023	arXiv
Vision-Language Pre-training: A Survey	2022	arXiv
Self-Supervised Multimodal Learning: A Survey	2021	arXiv

---

🤝 Contributing

Contributions are welcome! If you know of other great multimodal resources, please feel free to open a pull request.

---

📄 License

This repository is licensed under the MIT License.