Skip to content

val-iisc/MirrorVerse

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MirrorVerse: Pushing Diffusion Models to Realistically Reflect the World

CVPR 2025

Ankit Dhiman 1,2* · Manan Shah 1* · R Venkatesh Babu 1

* Equal Contribution
1 Vision and AI Lab, IISc Bangalore
2 Samsung R & D Institute India - Bangalore

Paper PDF Project Page Dataset Reflecting Reality
MirrorVerse Teaser

🧠 Overview

MirrorVerse builds upon our prior work Reflecting Reality, pushing the frontier of mirror reflection generation by adding diversity in the synthetic dataset creation pipeline and leveraging curriculum learning for generalizing to real-world scenes.

We introduce SynMirrorV2, a large-scale synthetic dataset containing 207K samples with full scene geometry, including depth maps, normal maps, and segmentation masks. SynMirrorV2 has high-fidelity training samples featuring variable object poses, occlusions, and multi-object setups.


🚀 Highlights

  • 📦 SynMirrorV2 Dataset: 207K synthetic samples with diverse object configurations and camera poses.
  • 🧩 Curriculum Learning Strategy: a curriculum learning strategy that progressively adapts to complex scenarios, enabling state-of-the-art model to generalize better to real-world reflections.
  • 🖼️ Multi-object Reflection Generation: First approach to effectively handle complex multi-object mirror scenes.
  • 📊 Robust Benchmarks: Demonstrates strong quantitative and qualitative gains over previous SOTA.

🗓️ TODO

  • [14/07/2025] 🔥 Release the SynMirrorV2 Dataset
  • Release 🔥 checkpoints trained on SynMirrorV2 Link
  • [07/06/2025] 🔥 Release codebase for creating synthetic dataset Link
  • [] Add interactive notebook demo for inference

💾 Checkpoint Details

The following table summarizes the key checkpoints mentioned in the project, along with their links and descriptions.

Checkpoint Name Link Description
MirrorFusion-v2 Google Drive This checkpoint is trained on single and multiple objects from SynMirrorV2.
MirrorFusion-v2-MSD Google Drive This checkpoint is finetuned on real-world MSD dataset.

🤝🏼 Citation

@inproceedings{dhiman2025mirrorverse,
  title={MirrorVerse: Pushing Diffusion Models to Realistically Reflect the World},
  author={Dhiman, Ankit and Shah, Manan and Babu, R Venkatesh},
  booktitle={Proceedings of the Computer Vision and Pattern Recognition Conference},
  pages={11239--11249},
  year={2025}
}

💖 Acknowledgements

This work builds on the foundation of Reflecting Reality. We also thank the developers of BlenderProc, diffusers, and SAM for their amazing tools and libraries.

About

Official repository for MirrorVerse: Pushing Diffusion Models to Realistically Reflect the World

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published