GitHub - KumarVaibhav27/DATABRICKS-x-DBT-End-To-End-Data-Engineering-Project: This project implements a modern data engineering pipeline using Databricks, PySpark, DBT, and Delta Live Tables. It follows the Medallion Architecture, supports realtime data ingestion with Autoloader, and models data with fact and dimension tables, including Slowly Changing Dimensions (SCD Type 2), all orchestrated in a scalable cloud environment

KumarVaibhav27 / DATABRICKS-x-DBT-End-To-End-Data-Engineering-Project Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

This project implements a modern data engineering pipeline using Databricks, PySpark, DBT, and Delta Live Tables. It follows the Medallion Architecture, supports realtime data ingestion with Autoloader, and models data with fact and dimension tables, including Slowly Changing Dimensions (SCD Type 2), all orchestrated in a scalable cloud environment