ETL-Pipeline-From-Scratch

An ETL pipeline to efficiently extract, transform and load data into PostgresSQL table

Pipeline steps

1. Extract data from upstream( using python request)
2. Clean and transform data
3. Define unique key, map data to table using SQLAlchemy
4. Load data into PostgresSQL table
5. Generate insights from data using SQL queries