Week2 Data Engineering Data warehouse

Table of Contents

• Project Structure
  • data
  • notebooks
  • DBT
  • Installation guide
  • Tech Stack
  • Getting Started
    • Prerequests
    • Installations
  • Tech Stack

images:

• images/ the folder where all snapshot for the project are stored.

logs:

• logs/ the folder where script logs are stored.

data:

• *.csv the folder where the dataset versioned csv files are stored.

.github:

• .github/: the folder where github actions and CML workflow is integrated.

models:

• models: the folder where DBT model queries are stored.

notebooks:

• prepare.ipynb: a jupyter notebook for exploring the data.

Tech Stack

Tech Stack used in this project

• PostgreSQL
• Apache Airflow
• dbt
• Redash

Contact

Melaku Alehegn - @email Contact Me - @contact