Releases: databricks/dbt-databricks
Releases · databricks/dbt-databricks
v1.10.5
What's Changed
- Fix inefficient query when getting column schema for MV/STs by @ericj-db in #1080
- Fix TypedConstraint equality check by @ericj-db in #1084
- Add cloning for the external tables by @samgans in #1079
- Do cascading drop when primary key constraint is removed from config by @ericj-db in #1088
- [FIX]: Fix issue with cloning of external tables by @samgans in #1095
- Ensure we can append with parquet, and delegate to DBSQL for possible errors by @benc-db in #1099
- Handle complex data types that are truncated by DESCRIBE TABLE by @ericj-db in #1093
- Fix MV/ST materializations with complex data types by @ericj-db in #1103
- Removing outdated docs and directing users to the main hosted documentation. by @benc-db in #1108
New Contributors
Full Changelog: v1.10.4...v1.10.5
v1.10.4
What's Changed
- Wait for library installation on python submission by @ericj-db in #1031
- Fix insert overwrite compile check when using model level compute override by @ericj-db in #1035
- Fix multiple foreign key constraints bug by @ericj-db in #1039
- Downgrade INSERT_OVERWRITE error to warning for SQL warehouses by @ericj-db in #1038
- Fix location_root case sensitivity by @ericj-db in #1043
- Set column comments on create for MV/ST by @ericj-db in #1046
- Add column mask support for tables and incremental by @ericj-db in #1033
- Fix insert_overwrite handling of schema update by @ericj-db in #1058
- Add metric_view as a relation type by @ericj-db in #1065
- Add column-level tag support for table, MV, ST, incremental by @ericj-db in #1062
- Fix ACL permissions not applied to notebook jobs created by DBT Python model by @case-k-git in #1015
- Disable unsetting table and column tags by @ericj-db in #1071
Full Changelog: v1.10.2...v1.10.4
v1.10.2
What's Changed
- Fix multiple null constraint situation by @benc-db in #1008
- Output the stack trace log when the DBT Python model job fails by @case-k-git in #1019
- Fix broken test_snapshot_new_record_mode by @ericj-db in #1023
- Constraints for incremental materialization by @ericj-db in #1013
- Fix: drop temp tables in python model materialization v2 by @ericj-db in #1026
- Migrate to the dbt catalog framework by @mikealfare in #1012
- Fix alter view dispatch by @mikealfare in #1029
New Contributors
Full Changelog: v1.10.1...v1.10.2
v1.10.1
What's Changed
- Fix: DBT Python Model Canceled Notebook Job Treated as Successful by @case-k-git in #985
- Adding internal table property delta.columnMapping.maxColumnId to ignore_list (#987) by @iamatharkhan in #991
- Strip trailing semi-colons. by @benc-db in #990
- Fix regression related to insert_overwrite by @benc-db in #992
- Replace illegal characters in unique temporary table names by @geo-martino in #995
- Unfreeze
requires_full_refresh
onDatabricksRelationChangeSet
by @geo-martino in #1000 - Drop pre-existing backup name from the adapter's cache by @geo-martino in #999
- Fixing view replace logic by @benc-db in #1004
New Contributors
- @iamatharkhan made their first contribution in #991
- @geo-martino made their first contribution in #995
Full Changelog: v1.10.0...v1.10.1
V1.10.0
Brief summary
Features
- Support databricks OAuth M2M auth type. Updated OAuth readme doc with instructions.(827)
- Introduced use_materialization_v2 flag for gating materialization revamps. (844)
- Introduce use_safer_relation_operations which will not change the production view/table unless new data can safely be ingested (927)
- adding view_update_via_alter, to allow updating views by altering, instead of recreating (954)
- Remover blockers to custom incremental strategies (972)
Under the Hood
- Update pinned python SDK version to 0.46.0 (969)
- Implement new constraint logic for use_materialization_v2 flag (846), (876)
- Quote constraint names if we quote column names (thanks @samuelberntzen!) (966)
- Streamlining debug logging to make it more usable (946)
- Upgrading Databricks SQL Connector to V4 (962)
- Validation of sample mode (961)
- Move liquid clustering behavior to on_config_change approach for incremental (968)
- Move column coments to on_config_change approach (981)
Fixes
- Switch to using full_data_type column when using info schema for column info (950)
While waiting for full documentation (coming shortly to the dbt Labs doc site), you can look at the discussion for the 1.10.0 alpha release in the discussion section for how to use the new features.
v1.10.0a2
What's Changed
- quote columns for foreign key and primary key constraints, if quote: true in column config by @samuelberntzen in #966
- Update sdk to 0.46.0 by @benc-db in #969
- Moving liquid clustering to the check for difference approach by @benc-db in #968
New Contributors
- @samuelberntzen made their first contribution in #966
Full Changelog: v1.10.0a1...v1.10.0a2
Small update to Monday's alpha.
v1.10.0a1
What's Changed (Pre-release)
Features
- Support databricks OAuth M2M auth type. Updated OAuth readme doc with instructions.(827)
- Introduced use_materialization_v2 flag for gating materialization revamps. (844)
- Introduce Tables V2, including safe_table_create which will not change the production table unless new data can safely be ingested (927)
- Views V2, including renaming safe_table_create to use_safer_relation_operations, and adding view_update_via_alter, to allow updating views by altering, instead of recreating (954)
Under the Hood
1.9.7 with looser tests for DBR
Do not use this release.