Pinned Loading

1. udacity-data-eng-proj-1 udacity-data-eng-proj-1 Public

   Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation, validation and loading of data from S3 -> Redshift -> S3

   Python 90 58

2. udacity-data-eng-proj3 udacity-data-eng-proj3 Public

   Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.

   Python 29 17

3. udacity-data-eng-proj2 udacity-data-eng-proj2 Public

   A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract data from S3, apply a series of transformations and load into …

   Jupyter Notebook 24 16

4. udacity-data-eng-proj4 udacity-data-eng-proj4 Public

   Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as a set of dimensional tables. Lake Processing: Spark, Lake St…

   Jupyter Notebook 16 12

5. api-to-postgres api-to-postgres Public

   Store data from an API into a Postgres table

   Python 3 5