Fully unit tested utility functions for data engineering. Python 3 only.
-
Updated
Aug 22, 2024 - Python
Fully unit tested utility functions for data engineering. Python 3 only.
Python version of dbtools
Schema definitions and management of our metadata used by the Data Engineering Team at MoJ
Conforms pandas to "correct" datatypes to ensure data in/out using CSV, JSONL and Parquet is read the same (using arrow).
Docker image used to automatically validate data
Little helper to write IAM policies
Add a description, image, and links to the dmet-python-packages topic page so that developers can more easily learn about it.
To associate your repository with the dmet-python-packages topic, visit your repo's landing page and select "manage topics."