What's Changed
-
Added Implementation of DQDL Rules and Execution
- add implementation of DQDL rule execution by @happy-coral in #620
- Add implementation of outcome mapping in DeequOutcomeTranslator by @happy-coral in #621
- Add implementation for DQDL rules: CompletenessRule, IsCompleteRule, UniquenessRule, IsUniqueRule, ColumnCorrelationRule by @happy-coral in #622
- Add implementation for DQDL rules: DistinctValuesCount, Entropy, Mean, StandardDeviation, Sum, UniqueValueRatio by @happy-coral in #624
- Update README to describe DQDL support and add Java & Scala DQDL examples by @happy-coral in #634
- Add support for DQDL IsPrimaryKey rule by @happy-coral in #635
- Add support for DQDL ColumnLength rule by @eycho-am in #636
-
Modify Histogram to be in descending frequency by @kyraman in #630
-
Introduce HistogramBase for common histogram behavior by @kyraman in #631
-
Modify maven publishing to use central portal by @eycho-am in #633
-
Add support for DQDL CustomSql rule & Deequ CustomSql check by @happy-coral in #632
-
fix(kll): Add SerDe Implementation for KLLSketch by @mdrakiburrahman in #628
-
Updated version in pom.xml to 2.0.12-spark-3.5 by @eycho-am in #637
New Contributors
- @kyraman made their first contribution in #630
- @mdrakiburrahman made their first contribution in #628
Full Changelog: 2.0.11...2.0.12
Contributors
kyraman, mdrakiburrahman, and 2 other contributors