This code implements an ELT pipeline for the Weather Sync project, which gets Weather and Air quality data from multiple sources and loads it into a data lake.
Reliable Data Processing: Ensure clean and structured data flows into analytical environments.
Technology Stack Programming Language: Python 🐍
Data Orchestration Framework: Apache Airflow
CI Tool: Sonarqube
Containerization: Docker