Requesting integration with Amazon S3 as a data lake

• Data lake is built upon Amazon S3
• Most of Transformations/ETL are done in AWS GLUE with Spark and there is a dbt-glue-adapter which supports running dbt against Spark
• Some of the ETL jobs are orchestrated with Airflow
• Running the queries on GLUE Data Catalog with Amazon Athena

Want to set up data observability on top of input and output datasets.

_ELE-47