Skip to content

davidolima/image-to-pcd-patchfusion

 
 

Repository files navigation

Metric Point Cloud Creation from Single Images using Depth Anything Model

This project leverages the Depth Anything model to create metric point clouds from single images. This repository includes all necessary scripts and files to perform depth estimation and generate accurate 3D point clouds with real-world measurements.

Requirements


To install the required packages, run: pip install -r requirements.txt

Installation


  1. Clone this repository: git clone https://github.com/bohdanvodianyk/image-to-pcd.git cd your-repo-name
  2. Install the necessary Python packages: pip install -r requirements.txt
  3. Download the model checkpoints from Google Drive and place them in the appropriate directory within the project.

Usage


Calibration

Before generating point clouds, calibrate your camera using the calibration-camera.py script. Ensure you have a chessboard pattern printed for the calibration process.

Depth Estimation to Point Cloud

To convert depth maps into metric point clouds, use the depth_to_pointcloud.py script. Ensure your input image is correctly formatted and accessible.

HEIC to PNG Conversion

If your input images are in HEIC format, convert them to PNG using the heic2png.py script.

Model Checkpoints


Model checkpoints necessary for depth estimation can be downloaded from the following Google Drive link:

Google Drive - Model Checkpoints

Download and place these checkpoints in the appropriate directory within your project to ensure the model functions correctly.

Acknowledgements


Special thanks to the developers of the Depth Anything model and all contributors who made this project possible. Your work in computer vision and deep learning is greatly appreciated.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 99.8%
  • Shell 0.2%