Simple demo of some features of the Esper Complex Event Processing (CEP) engine.
-
Updated
Apr 9, 2021 - Java
Simple demo of some features of the Esper Complex Event Processing (CEP) engine.
This project demonstrates real-world big data engineering practices using Apache Spark (PySpark). It covers the entire data pipeline — from ingestion, transformation, and validation to exploration and reporting. Ideal for data engineers and analysts looking to gain practical experience with Spark, Airflow, and data lake design.
Process of scheduled data extraction, transform and load is done using Apache Airflow and PySpark
Add a description, image, and links to the data-engin topic page so that developers can more easily learn about it.
To associate your repository with the data-engin topic, visit your repo's landing page and select "manage topics."