An Improvement study based on ZoeDepth for Zero-shot Depth Estimation
Background • How To Use • Sample Results • Credits
This study aims to develop a new model to improve the generalization ability of metric depth estimation (MDE) of the ZoeDepth model. Based on it we designed a new module to introduce focal length information, aiming to capture the relevant information in indoor and outdoor images and achieve better performance.
The trained model would output a matrix of size 384 x 512, where each value in the matrix is the MDE corresponds to the relevant pixel of the input image.
To run this model, simply clone the repo and ensure you have the following packages installed (other than PyTorch):
Run main.py , wait for the gradio interface to launch, then head to http://127.0.0.1:7860 on your browser.
Voila!
My teammate on this project: Eva Zhou