Skip to content

shantanupatne/sensorfusion

Repository files navigation

Udacity: Sensor Fusion Nanodegree

Projects:

Tech - C++, MATLAB, PCL, OpenCV

Involves processing the LIDAR point cloud using PCL to identify cars and other obstacles apart from the road.

Implemented custom RANSAC-based segmentation to separate the road from other obstacles.

Then defined a custom KD-Tree structure for efficient clustering of the LIDAR points, which are then collected in a bounding box to indicate the obstacles.

The resulting output looks like: Output

Conducted 2D feature tracking using different keypoint detectors and descriptors available in OpenCV library, and compared them to find the optimal pair.

Comparison is done based on processing times and number of keypoint matches.

Output

Combined LIDAR and Camera data to track objects in real-time. A YOLO object detection model is used to identify and segment individual objects.

Used 2D feature matching algorithms to match the identified objects across the video frames. Used this information to compute the Time-To-Collision (TTC).

Also performed a comparison across the detectors and descriptors available in OpenCV based on processing times and TTC values.

Simulated an FMCW radar for target detection in MATLAB.

Used Range-Doppler estimation with CFAR to obtain accurate target localization.

Combined the acquired sensor information from LIDAR and Radar.

Implemented a complete Unscented Kalman Filter on LIDAR and RADAR datapoints to accurately estimate and track surrounding vehicles.

Used CTRV model for vehicle tracking and obtained close estimates of the vehicle positions and velocities.

Output

About

Projects developed in the Sensor Fusion Nanodegree program

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published