Data Warehouse Automation Schema v2.0
New features
- Documentation page, which triggers on any commit into 'main' and updates the Github pages: https://data-solution-automation-engine.github.io/data-warehouse-automation-metadata-schema/.
- Introduction of various interfaces in the object model, to enforce standards and make it easier to work with different types of objects. Conceptually this replaces the dynamic types.
- Addition of various HandleBars helpers.
- All samples / templates updated and refreshed.
A core change is that the 'Data Query' concept has been split out into a query at Data Item level (DataItemQuery) and one at Data Object level (DataObjectQuery). Both types share the same interface, and have various shared properties.
However, they also have their own properties that are only relevant for their 'level'. For example, a connection applies to the Data Object Query, but not to the Data Item Query. Similarly, an ordinal position applies to the Data Item Query, but not to the Data Object Query.
Breaking changes
For the introduction of the interfaces, various minor inconsistencies have been corrected which will have an impact on the templates used. The templates and samples have been corrected, but any projects using this latest version have to be mindful that some property names have changes.
Data Object Mapping
- 'name' has been made mandatory
- 'mappingClassifications' has been renamed to 'classifications'
- 'businessKeys' has been renamed to 'businessKeyDefinitions'
Data Classification
- The Classification object/class has been renamed to 'DataClassification'
Extension
- 'description' has been renamed to 'notes'
Data Object
- 'dataObjectName' has been renamed to 'name'
- 'dataObjectConnection' has been renamed to 'dataConnection'
- 'dataObjectClassifications' has been renamed to classifications
Data Query
- Split into 'DataItemQuery' and 'DataObjectQuery'
- 'dataQueryName' has been renamed to 'name'
- 'dataQueryCode' has been renamed to 'queryCode'
- 'dataQueryLanguage' has been renamed to 'queryLanguage'
Data Connection
- 'connectionstring' has been renamed to 'name'
Business Key Definition
- 'businessKeyClassification' has been renamed to 'classifications'
Data Item
- 'dataItemClassification' has been renamed to 'classifications'
Bug fixes
N/A