Releases: datafusion-contrib/datafusion-table-providers
Releases · datafusion-contrib/datafusion-table-providers
v0.8.1
What's Changed
- Improve the read performance of Postgres' Decimals by @nuno-faria in #438
Full Changelog: v0.8.0...v0.8.1
v0.8.0
What's Changed
- Bump uuid from 1.17.0 to 1.18.0 by @dependabot[bot] in #417
- Bump rand from 0.9.1 to 0.9.2 by @dependabot[bot] in #415
- Bump rstest from 0.25.0 to 0.26.1 by @dependabot[bot] in #414
- Bump dyn-clone from 1.0.19 to 1.0.20 by @dependabot[bot] in #413
- Bump prost from 0.13.5 to 0.14.1 by @dependabot[bot] in #412
- ClickHouse: Add python module by @trueleo in #418
- Upgrade datafusion to version 50 by @nuno-faria in #437
Full Changelog: v0.7.0...v0.8.0
v0.7.0
What's Changed
- Bump tokio from 1.45.1 to 1.46.1 by @dependabot[bot] in #393
- Upgrade datafusion to version 49, datafusion-federation to version 0.4.7 by @nuno-faria in #407
Full Changelog: v0.6.3...v0.7.0
v0.6.3
What's Changed
- feat: Add temporary option to CreateTableBuilder by @nuno-faria in #398
- Bump datafusion-federation to 0.4.6 by @nuno-faria in #401
Full Changelog: v0.6.2...v0.6.3
v0.6.2
What's Changed
- Clickhouse: Remove unused AstAnalyzer from executor by @trueleo in #373
- Clickhouse: Remove pub visibility from two unused modules by @trueleo in #376
- Bump arrow-array from 55.1.0 to 55.2.0 by @dependabot[bot] in #381
- Bump test-log from 0.2.17 to 0.2.18 by @dependabot[bot] in #380
- Bump reqwest from 0.12.20 to 0.12.21 by @dependabot[bot] in #379
- Bump arrow-schema from 55.1.0 to 55.2.0 by @dependabot[bot] in #378
- Build on docs.rs with all features enabled by @trueleo in #375
- Bump datafusion-federation to 0.4.5 by @nuno-faria in #383
Full Changelog: v0.6.1...v0.6.2
v0.6.1
What's Changed
- Clickhouse: Add read only table provider for clickhouse by @trueleo in #369
- Set ClickHouse version to 0.13.3 by @trueleo in #371
- Bump prost from 0.14.0 to 0.14.1 by @dependabot in #372
Full Changelog: v0.6.0...v0.6.1
v0.6.0
What's Changed
- Bump prost from 0.13.5 to 0.14.0 by @dependabot in #367
- Bump bollard from 0.19.0 to 0.19.1 by @dependabot in #366
- Bump reqwest from 0.12.19 to 0.12.20 by @dependabot in #365
- Update Datafusion to 48, datafusion-federation to 0.4.3 by @askarbozcan in #370
New Contributors
- @askarbozcan made their first contribution in #370
Full Changelog: v0.5.0...v0.6.0
v0.5.0
What's Changed
- Bump crossbeam-channel from 0.5.14 to 0.5.15 in the cargo group by @dependabot in #312
- Bump anyhow from 1.0.97 to 1.0.98 by @dependabot in #314
- Bump odbc-api from 12.0.0 to 12.0.1 by @dependabot in #313
- Fix schema for projection with no columns by @phillipleblanc in #315
- Postgres: Make json/jsonb schema type and record types consistent (Utf8) by @sgrebnov in #318
- Bump arrow-odbc from 16.0.0 to 16.0.1 by @dependabot in #321
- Fix unused warnings by @trueleo in #325
- Bump sea-query from 0.32.3 to 0.32.4 by @dependabot in #323
- Bump rand from 0.9.0 to 0.9.1 by @dependabot in #322
- feat: Create Python integration testing by @crystalxyz in #320
- Bump odbc-api from 12.0.1 to 12.0.2 by @dependabot in #326
- Bump insta from 1.42.2 to 1.43.1 by @dependabot in #331
- Bump sha2 from 0.10.8 to 0.10.9 by @dependabot in #332
- Bump chrono from 0.4.40 to 0.4.41 by @dependabot in #330
- Bump mysql_async from 0.35.1 to 0.36.0 by @dependabot in #327
- Python feature flags by @ccciudatu in #337
- Bump sea-query from 0.32.4 to 0.32.5 by @dependabot in #338
- Bump tokio from 1.44.2 to 1.45.0 by @dependabot in #339
- Bump tempfile from 3.19.1 to 3.20.0 by @dependabot in #342
- Upgrade datafusion to 47 and datafusion-federation to 0.4.2 by @nuno-faria in #324
- Upgrade dependencies by @phillipleblanc in #363
- Merge spiceai changes since 0.4: Custom DuckDB settings, more robust DuckDB attachment logic, broader type support for DuckDB tables by @phillipleblanc in #364
- Don't pushdown filters with subqueries by @phillipleblanc in #316
New Contributors
Full Changelog: v0.4.0...v0.5.0
v0.4.0
What's Changed
- Revert "Revert "Bump secrecy version"" by @sgrebnov in #254
- Upgrade secrecy crate by @phillipleblanc in #256
- Upgrade Duckdb to 1.2.1 by @phillipleblanc in #257
- Upgrade datafusion-federation by @phillipleblanc in #258
- Upgrade federation by @phillipleblanc in #259
- Add primary keys mismatch verification for DuckDB table creation by @sgrebnov in #260
- Add indexes mismatch detection for DuckDB table creation by @sgrebnov in #261
- Add test for DuckDB
memory_limitparam by @sgrebnov in #263 - Use
quote_identifierfor table name when fetching existing primary keys by @sgrebnov in #265 - Bump tokio from 1.44.0 to 1.44.1 by @dependabot in #270
- Bump async-trait from 0.1.87 to 0.1.88 by @dependabot in #269
- Add test for DuckDB memory_limit option (#263) by @sgrebnov in #273
- Add indexes and primary keys mismatch detection for DuckDB by @sgrebnov in #272
- feat: Add python FFI interface and expose sqlite and duckdb table providers by @crystalxyz in #264
- Defer index/constraint creation until after the initial data load. by @phillipleblanc in #280
- Bump reqwest from 0.12.12 to 0.12.15 by @dependabot in #286
- Bump geo-types from 0.7.15 to 0.7.16 by @dependabot in #285
- Bump rstest from 0.24.0 to 0.25.0 by @dependabot in #284
- Bump uuid from 1.15.1 to 1.16.0 by @dependabot in #283
- refactor: New TableManager interfaces for DuckDB by @peasee in #287
- Bump time from 0.3.39 to 0.3.41 by @dependabot in #282
- fix: Make an initial table during
TableProviderFactory::create()for DuckDB by @peasee in #290 - Fixes a warning about missing indexes that shouldn't show up for newly created tables. by @phillipleblanc in #292
- De-duplicate attachments in DuckDBAttachments by @phillipleblanc in #294
- Allow connection pool size configuration for duckdb connection pool by @Sevenannn in #275
- Bump sea-query from 0.32.2 to 0.32.3 by @dependabot in #295
- Add DuckDB setting 'preserve_insertion_order` by @phillipleblanc in #298
- Update the PostgreSQL query to support inferring the schema from materialized views by @ewgenius in #300
- Upgrade mysql_async, expose metrics and remove unnecessary type parameters by @phillipleblanc in #302
- Expose the connection pool metrics via the table factory by @phillipleblanc in #304
- Support the
pool_minandpool_maxMySQL connection parameters by @phillipleblanc in #305 - Upgrade to DataFusion 46 by @phillipleblanc in #309
- Bump bigdecimal from 0.4.7 to 0.4.8 by @dependabot in #306
- Bump openssl from 0.10.71 to 0.10.72 in the cargo group by @dependabot in #303
- Bump tokio from 1.44.1 to 1.44.2 by @dependabot in #307
- Bump odbc-api from 11.1.1 to 12.0.0 by @dependabot in #308
- Improve DuckDB insert performance; support Postgres materialized views; MySQL connection metrics by @phillipleblanc in #311
- feat: Implement Python ODBC, MySQL, Postgres, Flight table providers by @crystalxyz in #281
New Contributors
- @crystalxyz made their first contribution in #264
Full Changelog: v0.3.0...v0.4.0
v0.3.0
What's Changed
- Update
spiceaibranch with latest changes by @phillipleblanc in #83 - DuckDB streaming by @y-f-u in #41
- fix: Disable federation in memory mode by @peasee in #86
- Add feature flag to disable postgres federation by @Sevenannn in #87
- SQLite: Validate expected indexes when attaching local datasets by @sgrebnov in #88
- SQLite: Validate expected primary keys when attaching local datasets by @sgrebnov in #89
- Change to use Spice AI fork of sea_query for SQLite decimal support by @phillipleblanc in #90
- fix: Don't silence blocking task errors by @peasee in #91
- fix: Re-attach databases on each DuckDB query by @peasee in #92
- Correctly handle mysql timestamp() and datetime() types by @Sevenannn in #96
- Postgres enum support by @Sevenannn in #100
- Fix SQLite
Invalid column type Realerror by @sgrebnov in #98 - Prevent SQLite from writing incomplete data on transition errors by @sgrebnov in #101
- DuckDBTableProviderFactory keeps track of opened instances by @phillipleblanc in #105
- Ignore CHECKPOINT errors for DuckDB by @phillipleblanc in #107
- Don't attempt to CHECKPOINT after writing to DuckDB by @phillipleblanc in #108
- SqliteTableProviderFactory keeps track of opened instances by @phillipleblanc in #109
- Support all time() types in MySQL by @Sevenannn in #97
- Upgrade to Arrow 53, DataFusion 42 and DuckDB 1.1 by @phillipleblanc in #111
- Handle inconsistent scale in Postgres Numeric Type data by @Sevenannn in #110
- Verify MySQL parameters and connections before creating connection pool by @Sevenannn in #113
- Propagate MySQL wrong table error by @Sevenannn in #114
- Fix MySQL timestamp type by @Sevenannn in #116
- Postgres should respect target decimal precision and scale by @sgrebnov in #120
- Update row -> arrow conversion for all MYSQL_TYPE_VAR_STRING and MYSQL_TYPE_STRING types by @Sevenannn in #118
- Use Decimal256 / Decimal128 for MySQL decimal type by @Sevenannn in #115
- Fix mysql blob & text types by @Sevenannn in #117
- Add sqlite_busytimeout parameter as user configurable param by @Sevenannn in #121
- Use arrow dictionary type for mysql enum type by @Sevenannn in #119
- Remove prefix for sqlite busy timeout param by @Sevenannn in #123
- Support parsing sqlite busy_timeout durations with units by @Sevenannn in #124
- Support retries when writing data to SQLite by @sgrebnov in #125
- Implement write retry for DuckDB by @Sevenannn in #128
- Preserve records batch order (update datafusion-federation) by @sgrebnov in #130
- fix: add ast analyzer for mysql rank by @peasee in #131
- fix: Remove NULLS FIRST/LAST in more MySQL Window functions by @peasee in #133
- Update datafusion-federation crate to include
unnestsupport by @sgrebnov in #136 - Update datafusion-federation to the latest by @sgrebnov in #137
- Update datafusion-federation (improve filters pushdown) by @sgrebnov in #149
- tests: Ensure all tests run on PRs, try to fix flaky DuckDB test (#150) by @peasee in #152
- Implement native schema inference for PostgreSQL by @phillipleblanc in #151
- Fix DuckDB error messages by @phillipleblanc in #154
- SQLite: use projected schema when converting records by @sgrebnov in #158
- feat: Enable in-memory federation by @peasee in #159
- Always read TimezoneTZ from PostgreSQL as UTC by @phillipleblanc in #161
- fix: Prevent absolute sequences in file paths by @peasee in #160
- Remove restriction on file being in working directory by @phillipleblanc in #163
- Include unnecessary columns pruning step during federated plan creation by @sgrebnov in #162
- feat: add duckdb checks for unsupported column types by @peasee in #164
- fix: DuckDB boolean list support by @peasee in #169
- Upgrade to DataFusion 43 by @phillipleblanc in #167
- Use DuckDB Dialect and update Datafusion patch by @Sevenannn in #170
- Free up disk space for integration test by @Sevenannn in #171
- Fix
MySQLConnection::get_schemafor uppercaseTableReferenceby @Jeadie in #166 - Fix MySQL timestamp conversion when running via
MySQLSQLExecby @sgrebnov in #173 - Handle all MySQL Timestamp types as UTC time by @Sevenannn in #174
- Fix MySQL test by @Sevenannn in #181
- Fix MySQL errors by @Sevenannn in #180
- Further improve MySQL error to be concise and specific by @Sevenannn in #184
- Update DuckDB Error messages by @Sevenannn in #182
- Improve Postgres errors by @Sevenannn in #183
- Separate MySQL error source to separate line by @Sevenannn in #185
- refactor: update dbconnection errors by @peasee in #188
- Handle invalid data types for Postgres by @phillipleblanc in #191
- Fix writing to a Postgres table with a schema by @sgrebnov in #195
- Fix insert statement when all columns are constraint columns by @phillipleblanc in #196
- Fix writing to a Postgres table with a schema by @sgrebnov in #197
- Allow overriding the default DuckDB dialect by @sgrebnov in #201
- Fix DuckDBDialect creation according to DataFusion DuckDBDialect update by @sgrebnov in #202
- DuckDB: support for nested types in Lists (Struct, List, FixedSizeList) by @sgrebnov in #203
- Fix datafusion federation by @Sevenannn in...