Apache Iceberg 1.9.2

What's Changed

• Stop retrying on 502 / 504 by @singhpk234 in #13461

Full Changelog: apache-iceberg-1.9.1...apache-iceberg-1.9.2

Apache Iceberg 1.9.1

What's Changed

• Core: Ensure reactivated view version uses correct timestamp by @lliangyu-lin in #12821
• API, Build: Explicitly pass version into Git Properties Plugin by @RussellSpitzer in #12949
• Bump Apache Parquet to 1.15.2 by @Fokko
• Core: Revert #12670 to Temporarily Restore Sending Single Snapshot Changes Rather than in Bulk by @aihuaxu in #13100

Full Changelog: apache-iceberg-1.9.0...apache-iceberg-1.9.1

Apache Iceberg 1.9.0

What's Changed

• Build: Bump software.amazon.awssdk:bom from 2.30.11 to 2.30.16 by @dependabot in #12208
• Build: Bump com.google.cloud:libraries-bom from 26.53.0 to 26.54.0 by @dependabot in #12207
• Build: Bump org.xerial:sqlite-jdbc from 3.48.0.0 to 3.49.0.0 by @dependabot in #12206
• Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4.1 to 5.4.2 by @dependabot in #12209
• Docs: Fix expire_snapshots output by @manuzhang in #12213
• Update LICENSE/NOTICE files with last dependency updates by @jbonofre in #12214
• Doc: update note about notebook in spark-quickstart by @xxchan in #11996
• Spec: Support geo type by @szehon-ho in #10981
• Build: skip scheduled docker image publish workflows on forks by @dramaticlly in #12218
• Docs: Add missing types to the spec v3 summary by @wgtmac in #12219
• Spec: Typo - missing be by @RussellSpitzer in #12229
• Docs: Site update for 1.8.0 release by @amogh-jahagirdar in #12242
• spec: Remove source-ids for V{1,2} tables by @Fokko in #12161
• Build: Update revAPI to compare against 1.8.0 by @amogh-jahagirdar in #12244
• Update release version to 1.8.0 in doap.rdf by @amogh-jahagirdar in #12247
• Infra: Update Iceberg bug report template for 1.8.0 by @amogh-jahagirdar in #12248
• Docs: Fix formatting of 1.8.0 release notes by @amogh-jahagirdar in #12249
• Core: Adjust Jackson settings to handle large metadata json by @bryanck in #12224
• Build: Bump Hive to 2.3.10 by @nastra in #12253
• Build: Clean up dependencies by @nastra in #12252
• Core: Add InternalData read and write builders by @rdblue in #12060
• API, Core: Support default values in UpdateSchema by @rdblue in #12211
• update site to include iceberg summit link by @danicafine in #12256
• Core: Fix divide by zero when adjust split size by @hantangwangd in #12201
• Spark: Remove unused PruneColumnsWithReordering class by @rdblue in #12258
• Spark: Fix assertion checks by @nastra in #12255
• API: Deprecate NestedType.of in favor of builder by @rdblue in #12227
• Docker: Pin QEMU version temporarily by @ebyhr in #12262
• OpenAPI: Add RemoveSchemas REST update type by @gaborkaszab in #12022
• Minor: update Learn More to point to spark quickstart by @danicafine in #12272
• Build: Bump datamodel-code-generator from 0.27.2 to 0.28.1 by @manuzhang in #12290
• Spark 3.5: Fix job description of RewriteTablePathSparkAction by @ebyhr in #12282
• Build: Bump io.netty:netty-buffer from 4.1.117.Final to 4.1.118.Final by @dependabot in #12287
• Build: Bump software.amazon.awssdk:bom from 2.30.16 to 2.30.21 by @dependabot in #12286
• OpenAPI: Add overwrite option when registering an iceberg table by @dramaticlly in #12239
• Build: Bump mkdocs-material from 9.6.3 to 9.6.4 by @dependabot in #12284
• Core: Fix non-setting row-lineage from table properties on initial table creation by @tomtongue in #12307
• API: Reject unknown type for required fields and validate defaults by @rdblue in #12302
• API: Fix TestInclusiveMetricsEvaluator notStartsWith tests by @rdblue in #12303
• Core: add variant type support by @aihuaxu in #11831
• Fix CI: Update tests with UnknownType from Required to Optional by @Fokko in #12316
• Docs: Refactor site navigation bar by @manuzhang in #12289
• Parquet: Implement Variant readers by @rdblue in #12139
• Docs: Add rewrite-table-path in spark procedure by @dramaticlly in #12115
• Parquet: Fix errorprone warning by @ebyhr in #12324
• Docs: add apache amoro(incubating) with iceberg (#11965) by @czy006 in #11966
• Parquet: Fix performance regression in reader init by @bryanck in #12305
• Core: Fallback to GET requests for namespace/table/view exists checks by @nastra in #12314
• Fix: fix apache amoro ams doc pic ref by @czy006 in #12332
• Revert "Core: Serialize null when there is no current snapshot" by @Fokko in #12312
• [1.8.x] Parquet: Fix performance regression in reader init (#12305) by @nastra in #12329
• Checkstyle: Apply the same generic type naming rules to interfaces and classes by @pvary in #12333
• Kafka: Pin Kafka-Connect version to fix integration tests by @nastra in #12340
• Docs: Fix link of catalog in terms.md by @wangyinsheng in #12326
• Docs: Add documentation for Rate limiting in Spark Structured Streaming by @singhpk234 in #12217
• Spark 3.5: Fix Incorrect Spec Used With AddFiles Procedure by @RussellSpitzer in #12319
• Parquet: Remove deprecated VectorizedReader.setRowGroupInfo and ParquetValueReader.setPageSource by @ebyhr in #12321
• Bump versions in {LICENSE,NOTICE} by @Fokko in #12337
• Spark: Remove Spark 3.3 support by @manuzhang in #12279
• Core: Remove deprecated Util.blockLocations method and StructCopy class by @ebyhr in #12320
• Core: Handle partition evolution case in PartitionStatsUtil#computeStats by @deniskuzZ in #12137
• Core, Spark: Remove deprecated code for 1.9.0 by @nastra in #12336
• API: Move variant to API and add extract expression by @rdblue in #12304
• Core: Remove namespace/table/view HEAD endpoints from defaults by @nastra in #12351
• Nit: Remove additional 'Iceberg' in Puffin footer payload by @tomtongue in #12369
• API: Move Variant interfaces and serialized implementations to API by @rdblue in #12374
• Flink: Fix the comment error in SketchDataStatistics by @Guosmilesmile in #12375
• Core: Don't remove trailing slash from absolute paths by @adutra in #12389
• Build: Bump mkdocs-material from 9.6.4 to 9.6.5 by @dependabot in #12386
• Build: Bump org.xerial:sqlite-jdbc from 3.49.0.0 to 3.49.1.0 by @dependabot in #12385
• Build: Bump org.awaitility:awaitility from 4.2.2 to 4.3.0 by @dependabot in #12384
• Build: Bump nessie from 0.102.5 to 0.103.0 by @dependabot in #12383
• Build: Bump com.google.cloud:libraries-bom from 26.54.0 to 26.55.0 by @dependabot in #12382
• Build: Bump testcontainers from 1.20.4 to 1.20.5 by @dependabot in #12380
• Build: Bump software.amazon.awssdk:bom from 2.30.21 to 2.30.26 by @dependabot in #12379
• Spec: Allow Equality Deletes with Row Lineage and Define Behavior by @RussellSpitzer in #12230
• Core: Add "volatile" to HadoopFileIO#hadoopConf by @okumin in #12388
• Arrow, Parquet, Spark 3.5, Flink 1.20: Avoid deprecated method by @ebyhr in #11874
• Docs: Add Stackable to the Vendors page by @lfrancke in #12344
• Build: Upgrade to Gradle 8.13 by @jbonofre in #12398
• Kafka Connect: Add SMTs for Debezium and AWS DMS by @ismailsimsek in #11936
• API, Core: Update inclusive metrics evaluator for extract and transforms by @rdblue in #12311
• Build: remove Hadoop 2 dependency by @Kontinuation in #12348
• View Spec: Fix typo by @ajantha-bhat in #12405
• Fix grammar issues in descriptions about Hive environment in hive-quickstart.md by @wenxin-cn in #12402
• ...

apache-iceberg-1.7.2

What's Changed

• 1.7.x cherry pick #11526 by @bryanck in #11629
• [1.7] Revert "Support WASB scheme in ADLSFileIO" by @mrcnc in #11817
• Core, Spark, Flink, Hive: Remove unused failsafe dependency from core and add Failsafe to runtime LICENSE(s) by @amogh-jahagirdar in #11828
• [1.7.x] AWS, Core, GCP: Support relative credential endpoint / pass OAuth2 token to credential provider by @nastra in #11971
• Spark: Fix empty scan issue when start timestamp retrieves root snapshot and end timestamp is missing (#11967) by @Fokko in #11983
• Remove slf4j-api reference in LICENSE (#12052) by @Fokko in #12068
• [1.7.x] Core: Retain current view version during expiration (#12067) by @nastra in #12084
• Bump the versions of site/mkdocs.yml by @Fokko in #12175
• [1.7.x] Kafka: Pin Kafka-Connect version to fix integration tests by @Fokko in #12354
• [1.7.x] Bump Nessie to 0.120.5 to include updated License/Notice by @Fokko in #12356
• [1.7.x] Fix {LICENSE,NOTICE} for Kafka Connect Runtime by @Fokko in #12353
• [1.7.x] Fix {LICENSE,NOTICE} for Flink Runtime by @Fokko in #12358
• [1.7.x] Fix {LICENSE,NOTICE} for GCP Bundle by @Fokko in #12359
• [1.7.x] Fix {LICENSE,NOTICE} for AWS Bundle by @Fokko in #12360
• [1.7.x] Fix {LICENSE,NOTICE} for Azure Bundle by @Fokko in #12361
• [1.7.x] Fix {LICENSE,NOTICE} for Spark Runtime by @Fokko in #12355
• [1.7.x] Align azure-storage-blob version in azure-bundle LICENSE by @jbonofre in #12445
• [1.7.x] Fix Kafka-connect LICENSE and NOTICE by @Fokko in #12400
• [1.7.x] AWS: Don't fetch credential from endpoint if properties contain a valid credential (#12504) by @nastra in #12515

Full Changelog: apache-iceberg-1.7.1...apache-iceberg-1.7.2

apache-iceberg-1.8.1

What's Changed

• [1.8.x] Revert "Core: Serialize null when there is no current snapshot" by @Fokko in #12313
• [1.8.x] Core: Fallback to GET requests for namespace/table/view exists checks by @nastra in #12328
• [1.8.x] Core: Adjust Jackson settings to handle large metadata json (#12224) by @nastra in #12330
• [1.8.x] Parquet: Fix performance regression in reader init (#12305) by @nastra in #12338
• [1.8.x] Kafka: Pin Kafka-Connect version to fix integration tests by @nastra in #12341
• [1.8.x] Build: Revert AWS SDK from 2.30.11 to 2.29.52 by @nastra in #12339
• [1.8.x] Core: Remove namespace/table/view HEAD endpoints from defaults (#12351) by @nastra in #12368
• [1.8.x] Core: Don't remove trailing slash from absolute paths by @adutra in #12390
• [1.8.x] Fix versions in LICENSE/NOTICE by @jbonofre in #12365

Full Changelog: apache-iceberg-1.8.0...apache-iceberg-1.8.1

apache-iceberg-1.8.0

What's Changed

• Doc: Update rewrite data files spark procedure by @dramaticlly in #11396
• Docs: warn parallelism > 1 doesn't work for migration procedures by @manuzhang in #11417
• Core: log retry sleep time by @sullis in #11413
• Core: Use RoaringPositionBitmap in position index by @aokolnychyi in #11441
• Core: Add validation for table commit properties by @dramaticlly in #11437
• Core: Add cardinality to PositionDeleteIndex by @aokolnychyi in #11442
• Puffin: Add delete-vector-v1 blob type by @rdblue in #11238
• Spec v3: Add deletion vectors to the table spec by @rdblue in #11240
• API, Core: Add data file reference to DeleteFile by @aokolnychyi in #11443
• Build: Bump software.amazon.awssdk:bom from 2.29.1 to 2.29.6 by @dependabot in #11454
• Build: Bump com.gradleup.shadow:shadow-gradle-plugin from 8.3.3 to 8.3.5 by @dependabot in #11452
• Build: Bump com.google.cloud:libraries-bom from 26.49.0 to 26.50.0 by @dependabot in #11451
• Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4 to 5.4.1 by @dependabot in #11450
• Build: Bump com.azure:azure-sdk-bom from 1.2.28 to 1.2.29 by @dependabot in #11453
• Flink: Maintenance - TableManager + ExpireSnapshots by @pvary in #11144
• Build: Bump mkdocs-material from 9.5.42 to 9.5.43 by @dependabot in #11455
• Build: Bump net.snowflake:snowflake-jdbc from 3.19.1 to 3.20.0 by @dependabot in #11447
• Build: Bump kafka from 3.8.0 to 3.8.1 by @dependabot in #11449
• Build: Bump jackson-bom from 2.18.0 to 2.18.1 by @dependabot in #11448
• Core: Fix generated position delete file spec by @aokolnychyi in #11458
• API, Core: Add content offset and size to DeleteFile by @aokolnychyi in #11446
• Build: Revert Parquet to 1.13.1 by @RussellSpitzer in #11462
• Spark 3.5: Preserve data file reference during manifest rewrites by @aokolnychyi in #11457
• Core: Make PositionDeleteIndex serializable by @aokolnychyi in #11463
• Spark 3.5: Preserve content offset and size during manifest rewrites by @aokolnychyi in #11469
• Spark 3.5: Fix flaky test due to temp directory not empty during delete by @manuzhang in #11470
• Core, Data, Flink, Spark: Improve tableDir initialization for tests by @nastra in #11460
• Core: Support DVs in DeleteFileIndex by @aokolnychyi in #11467
• Core: Adapt commit, scan, and snapshot stats for DVs by @aokolnychyi in #11464
• Spark: Merge new position deletes with old deletes during writing by @amogh-jahagirdar in #11273
• Fix ADLSLocation file parsing by @mrcnc in #11395
• open-api: Build runtime jar for test fixture by @ajantha-bhat in #11279
• Core, Puffin: Add DV file writer by @aokolnychyi in #11476
• Flink: Fix config key typo in error message of SplitComparators by @liuml07 in #11482
• API: Removes Explicit Parameterization of Schema Tests by @RussellSpitzer in #11444
• Docs: Fix verifying release candidate with Spark and Flink by @manuzhang in #11461
• Flink: Port #11144 to v1.19 by @pvary in #11473
• Docs: Fix format of verifying release candidate with Flink by @manuzhang in #11487
• Core: Support DVs in DeleteLoader by @aokolnychyi in #11481
• Infra: Update DOAP.RDF for Apache Iceberg 1.7.0 by @RussellSpitzer in #11492
• Docs: Site Update for 1.7.0 Release by @RussellSpitzer in #11494
• Infra: Add 1.7.0 to issue template by @RussellSpitzer in #11491
• Build: Let revapi compare against 1.7.0 by @RussellSpitzer in #11490
• Docs: Adds Release notes for 1.6.1 by @RussellSpitzer in #11500
• Docs: Fixes Release Formatting for 1.7.0 Release Notes by @RussellSpitzer in #11499
• Spec: Explicitly specify operation as a required field of Snapshot's summary field by @sungwy in #11355
• Exclude reading _pos column if it's not in the scan list by @huaxingao in #11390
• Build: Bump mkdocs-redirects from 1.2.1 to 1.2.2 by @dependabot in #11511
• Build: Bump mkdocs-material from 9.5.43 to 9.5.44 by @dependabot in #11510
• Build: Bump software.amazon.awssdk:bom from 2.29.6 to 2.29.9 by @dependabot in #11509
• Docs: Update multi-engine support after 1.7.0 release by @manuzhang in #11503
• Spark: Fix typo in spark ddl document by @hantangwangd in #11517
• Core: Support commits with DVs by @aokolnychyi in #11495
• Kafka Connect: fix Hadoop dependency exclusion by @bryanck in #11516
• Upgrade to Gradle 8.11.0 by @jbonofre in #11521
• Spark 3.5: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in #11480
• use dist/release KEYS by @kevinjqliu in #11526
• Remove iceberg-pig by @jbonofre in #11380
• Core, Flink, Spark: Verify maintenance actions with DVs by @nastra in #11485
• Spark: Use assumeThat(format).isEqualTo(FileFormat.PARQUET) instead of assumeThat(format).isEqualTo(parquet) by @huaxingao in #11540
• Spark 3.4: Support Spark Column Stats by @saitharun15 in #11532
• Docs: Fix rendering lists by @manuzhang in #11546
• Build: Bump kafka from 3.8.1 to 3.9.0 by @dependabot in #11508
• Support WASB scheme in ADLSFileIO by @mrcnc in #11504
• Docs: 4 Spaces are Required for Sublists by @RussellSpitzer in #11549
• API, Core, Spark: Ignore schema merge updates from long -> int by @rocco408 in #11419
• Docs: Fix level of Deletion Vectors by @manuzhang in #11547
• API, Core: Replace deprecated ContentFile#path usage with location by @amogh-jahagirdar in #11550
• API: Add Variant data type by @aihuaxu in #11324
• Spark 3.5: Adapt DeleteFileIndexBenchmark for DVs by @aokolnychyi in #11529
• Spark 3.5: Adapt PlanningBenchmark for DVs by @aokolnychyi in #11531
• Spark 3.5: Add DVReaderBenchmark by @aokolnychyi in #11537
• Build: Bump datamodel-code-generator from 0.26.2 to 0.26.3 by @dependabot in #11572
• Build: Bump software.amazon.awssdk:bom from 2.29.9 to 2.29.15 by @dependabot in #11568
• Build: Bump io.netty:netty-buffer from 4.1.114.Final to 4.1.115.Final by @dependabot in #11569
• Data, Flink, Spark: Test deletes with format-version=3 by @nastra in #11538
• Build: Bump nessie from 0.99.0 to 0.100.0 by @dependabot in #11567
• Build: Bump orc from 1.9.4 to 1.9.5 by @dependabot in #11571
• API, Arrow, Core, Data, Spark: Replace usage of deprecated ContentFile#path API with location API by @amogh-jahagirdar in #11563
• Core: Serialize null when there is no current snapshot by @Fokko in #11560
• Spark 3.4: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in #11579
• Spark 3.3: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in #11580
• Core: Inherited classes from SnapshotProducer has TableOperations red… by @gaborkaszab in #11578
• Revert "Core: Use encoding/decoding methods for namespaces and deprecate Splitter/Joiner" by @nastra in #11574
• Core: delete temp metadata file when version already exists by @leesf in https://github.com/apache...

Apache Iceberg 1.7.1

What's Changed

• Kafka Connect: fix Hadoop dependency exclusion (#11516)
• Azure: Fix ADLSLocation file parsing (#11395)
• Azure: Support WASB scheme in ADLSFileIO (#11504)
• Revert "Core: Use encoding/decoding methods for namespaces and deprecate Splitter/Joiner" (#11574)
• Spark 3.5: Fix NotSerializableException when migrating Spark tables (#11157)
• Spark: Fix changelog table bug for start time older than current snapshot (#11564)
• Revert "Core: Update TableMetadataParser to ensure all streams closed" (#11621)

Full Changelog: apache-iceberg-1.7.0...apache-iceberg-1.7.1

Apache Iceberg 1.7.0

What's Changed

• [DOCS] Fix link on Concepts page by @gaborkaszab in #10718
• Core: Support appending files with different specs by @fqaiser94 in #9860
• Remove unnecessary class-level synchronized in ManifestFiles by @findepi in #10544
• Spec: Clarify which columns can be used for equality delete files. by @emkornfield in #8981
• Build: Bump nessie from 0.92.1 to 0.93.1 by @dependabot in #10727
• Build: Bump org.testcontainers:testcontainers from 1.19.8 to 1.20.0 by @dependabot in #10730
• Build: Bump mkdocs-material from 9.5.28 to 9.5.29 by @dependabot in #10734
• Build: Bump org.roaringbitmap:RoaringBitmap from 1.2.0 to 1.2.1 by @dependabot in #10733
• Build: Bump software.amazon.awssdk:bom from 2.26.20 to 2.26.21 by @dependabot in #10729
• Build: Bump io.netty:netty-buffer from 4.1.111.Final to 4.1.112.Final by @dependabot in #10726
• Build: Bump orc from 1.9.3 to 1.9.4 by @dependabot in #10728
• Build: Bump com.google.errorprone:error_prone_annotations from 2.28.0 to 2.29.2 by @dependabot in #10731
• Flink: Migrate remaining classes to JUnit5 by @tomtongue in #10684
• Api, Build: Fix typo in comments in Table and gradlew by @hantangwangd in #10744
• Flink: parameterize Flink table source tests to test both old and FLIP-27 source implementations by @stevenzwu in #10741
• Core: Limit memory used by ParallelIterable by @findepi in #10691
• Flink: handle rescale properly and refactor statistics by @stevenzwu in #10457
• Flink: Backport other remaining classes by @tomtongue in #10749
• Spec: Clarify time travel implementation in Iceberg by @emkornfield in #8982
• Build: Let revapi compare against 1.6.0 by @ajantha-bhat in #10754
• Support for Flink's SpeculativeExecution in batch execution mode by @venkata91 in #10548
• API: Update StatisticsFile javadoc by @rice668 in #10769
• Flink: Remove JUnit4 dependency by @nastra in #10770
• Docs: Add bodo to iceberg vendors by @ritwika314 in #10756
• Core: Add estimateRowCount for Files and Entries Metadata Tables by @szehon-ho in #10759
• Update checkstyle definition by @attilakreiner in #10681
• API: Fix typo in RewriteManifestFiles java doc by @amogh-jahagirdar in #10778
• Update .asf.yaml by @ajantha-bhat in #10767
• Support building with Java 21 by @findepi in #10474
• Infra, Docs: Publish Apache Iceberg 1.6.0 release by @jbonofre in #10752
• Update iceberg version on site to 1.6.0 by @jbonofre in #10783
• Hive: close the fileIO client when closing the hive catalog by @hussein-awala in #10771
• Add jbonofre as collaborator on the project by @jbonofre in #10782
• Docs: Make compatibility example consistent. by @emkornfield in #10781
• mr：Fix issues 10639 by @lurnagao-dahua in #10661
• Flink: backport PR #10331 and PR #10457 by @stevenzwu in #10757
• Build: Bump software.amazon.awssdk:bom from 2.26.21 to 2.26.25 by @dependabot in #10800
• Build: Bump nessie from 0.93.1 to 0.94.2 by @dependabot in #10798
• Build: Bump net.snowflake:snowflake-jdbc from 3.17.0 to 3.18.0 by @dependabot in #10801
• Build: Bump mkdocs-material from 9.5.29 to 9.5.30 by @dependabot in #10796
• Flink: Disabling flaky test TestIcebergSourceFailover.testBoundedWithSavepoint by @pvary in #10802
• Build: Bump mkdocs-awesome-pages-plugin from 2.9.2 to 2.9.3 by @dependabot in #10795
• Kafka Connect: Runtime distribution with integration tests by @bryanck in #10739
• Flink: improve snapshot compatibility check by comparing projected sort schema in SortKeySerializer by @stevenzwu in #10794
• Flink: support limit pushdown in FLIP-27 source by @stevenzwu in #10748
• Flink: Remove MiniClusterResource in Flink by @tomtongue in #10817
• Docs: Use link addresses instead of descriptions in releases.md by @lurnagao-dahua in #10815
• Build: Declare avro as an api dependency of iceberg-core by @devinrsmith in #10573
• Flink: backport PR #10748 for limit pushdown by @stevenzwu in #10813
• [DOCS] Fix header for entries metadata table by @gaborkaszab in #10826
• Support Spark Column Stats by @huaxingao in #10659
• Support for Flink's SpeculativeExecution in batch execution mode - Backport of PR #10548 by @venkata91 in #10776
• Infra: Improve feature request template by @nastra in #10825
• Core: (unit test) Replace the duplicated ALL_DATA_FILES with ALL_DELETE_FILES by @hsiang-c in #10836
• Core: Adds Basic Classes for Iceberg Table Version 3 by @RussellSpitzer in #10760
• Core: Allow SnapshotProducer to skip uncommitted manifest cleanup after commit by @grantatspothero in #10523
• Flink: a few small fixes or tuning for range partitioner by @stevenzwu in #10823
• Core: Drop support for Java 8 by @findepi in #10518
• Build: Bump com.adobe.testing:s3mock-junit5 from 2.11.0 to 2.17.0 by @nastra in #10851
• Core: Upgrade Jetty and Servlet API by @nastra in #10850
• Build for Java 11 by @snazy in #10849
• Build: Bump kafka from 3.7.1 to 3.8.0 by @dependabot in #10797
• Build: Update baseline gradle plugin to 5.58.0 by @findepi in #10788
• Flink: refactor sink tests to reduce the number of combinations with parameterized tests by @stevenzwu in #10777
• Flink: backport PR #10823 for range partitioner fixup by @stevenzwu in #10847
• Core: Remove reflection from TestParallelIterable by @findepi in #10857
• Spec: Deprecate the file system table scheme. by @rdblue in #10833
• Core, API: Add addNonDefaultSpec to UpdatePartitionSpec to not set the new partition spec as default by @shanielh in #10736
• Build: Bump com.palantir.baseline:gradle-baseline-java from 5.58.0 to 5.61.0 by @dependabot in #10864
• Build: Bump nessie from 0.94.2 to 0.94.4 by @dependabot in #10869
• Build: Bump org.xerial:sqlite-jdbc from 3.46.0.0 to 3.46.0.1 by @dependabot in #10871
• Build: Bump org.apache.commons:commons-compress from 1.26.0 to 1.26.2 by @dependabot in #10868
• Build: Bump software.amazon.awssdk:bom from 2.26.25 to 2.26.29 by @dependabot in #10866
• Build: Bump mkdocs-material from 9.5.30 to 9.5.31 by @dependabot in #10863
• Build: Fix Scala compilation by @snazy in #10860
• Build: Enable FormatStringAnnotation error-prone check by @findepi in #10856
• Core: Use encoding/decoding methods for namespaces and deprecate Splitter/Joiner by @nastra in #10858
• Aliyun: Replace assert usage with assertThat by @nastra in #10880
• Core: Extract filePath comparator into it's own class by @deniskuzZ in #10664
• Docs: Fix SQL in branching docs by @nakaken-churadata in #10876
• API: Add SupportsRecoveryOperations mixin for FileIO by @amogh-jahagirdar in #10711
• Spec: Clarify identity partition edge cases. by @emkornfield in #10835
• Build: Bump org.testcontainers:testcontainers from 1.20.0 to 1.20.1 by @dependabot in #10865
• Flink: add 1.20 support and remove 1.17 by @stevenzwu in #10881
• Build: Add checkstyle rule to ba...

Apache Iceberg 1.6.1

What's Changed

• Core: Limit ParallelIterable memory consumption by yielding in tasks by @raunaqmorarka in #10787
• [1.6] Core: Drop ParallelIterable's queue low water mark by @findepi in #10979
• Build: Bump orc from 1.9.3 to 1.9.4 (#10728) by @Fokko in #10988

New Contributors

• @raunaqmorarka made their first contribution in #10787

Full Changelog: apache-iceberg-1.6.0...apache-iceberg-1.6.1

Apache Iceberg 1.6.0

What's Changed

• API, Spark 3.3: Remove all usages of deprecated AssertHelpers by @findepi in #10500
• API: Fix default FileIO#newInputFile ManifestFile, DataFile and DeleteFile implementation to pass lengths by @amogh-jahagirdar in #9953
• AWS, Core: Replace .withFailMessage() usage with .as() by @nastra in #10000
• AWS: Fix TestGlueCatalogTable#testCreateTable by @aajisaka in #10221
• AWS: Make sure Signer + User Agent config are both applied by @nastra in #10198
• AWS: Retain Glue Catalog column comment after updating Iceberg table by @lawofcycles in #10276
• AWS: Retain Glue Catalog table description after updating Iceberg table by @aajisaka in #10199
• AWS: Support S3 DSSE-KMS encryption by @aajisaka in #8370
• AWS: close underlying executor for DynamoDb LockManager by @regadas in #10132
• Add 13 Dremio Blogs + Fix a few incorrect dates by @AlexMercedCoder in #9967
• Add EnumConfParser to SparkConfParser by @huaxingao in #10311
• Add Pagination To List Apis by @rahil-c in #9782
• Add bloom filter fpp config by @huaxingao in #10149
• Add checkstyle rule for uppercase constant fields by @attilakreiner in #10673
• Add issue template and docs for iceberg proposals by @danielcweeks in #9932
• Add local nightly build to test current docs changes by @bitsondatadev in #9943
• Add stale PRs management by @jbonofre in #10134
• Add support for providing output-spec-id during rewrite - spark 3.5 by @himadripal in #9803
• Address Intellij inspection findings by @snazy in #10583
• Allow Java 17 in contribute.md by @findepi in #10545
• Apply IntelliJ inspection findings to older Spark + Flink versions by @snazy in #10625
• Avoid adding a closed client to the pool by @flyrain in #10337
• Aws: Add Iceberg version to UserAgent in S3 requests by @CsengerG in #9963
• Backport Flink 1.18 JUnit5 migration to Flink 1.17 by @tomtongue in #10163
• Backport HadoopCatalog related classes in Flink by @tomtongue in #10620
• Backport source package changes in Flink to other versions by @tomtongue in #10663
• Basic manifest encryption by @ggershinsky in #8252
• Build: Align Jackson versions by @nastra in #9925
• Build: Bump Nessie to 0.90.4 by @adutra in #10492
• Build: Bump Nessie to 0.91.2 by @adutra in #10563
• Build: Bump Spark 3.5 to 3.5.1 by @manuzhang in #9832
• Build: Bump arrow from 15.0.0 to 15.0.1 by @dependabot in #9910
• Build: Bump arrow from 15.0.1 to 15.0.2 by @dependabot in #10034
• Build: Bump com.azure:azure-sdk-bom from 1.2.20 to 1.2.21 by @dependabot in #9857
• Build: Bump com.azure:azure-sdk-bom from 1.2.21 to 1.2.22 by @dependabot in #10071
• Build: Bump com.azure:azure-sdk-bom from 1.2.22 to 1.2.23 by @dependabot in #10238
• Build: Bump com.azure:azure-sdk-bom from 1.2.23 to 1.2.24 by @dependabot in #10420
• Build: Bump com.azure:azure-sdk-bom from 1.2.24 to 1.2.25 by @dependabot in #10652
• Build: Bump com.esotericsoftware:kryo from 4.0.2 to 4.0.3 by @dependabot in #9984
• Build: Bump com.google.cloud:libraries-bom from 26.28.0 to 26.43.0 by @dependabot in #10699
• Build: Bump com.google.errorprone:error_prone_annotations from 2.24.1 to 2.26.1 by @dependabot in #9972
• Build: Bump com.google.errorprone:error_prone_annotations from 2.26.1 to 2.27.0 by @dependabot in #10236
• Build: Bump com.google.errorprone:error_prone_annotations from 2.27.0 to 2.28.0 by @dependabot in #10418
• Build: Bump com.gorylenko.gradle-git-properties:gradle-git-properties from 2.4.1 to 2.4.2 by @dependabot in #10239
• Build: Bump com.palantir.gradle.gitversion:gradle-git-version from 3.0.0 to 3.1.0 by @dependabot in #10468
• Build: Bump datamodel-code-generator from 0.25.4 to 0.25.5 by @dependabot in #9979
• Build: Bump datamodel-code-generator from 0.25.5 to 0.25.6 by @dependabot in #10242
• Build: Bump datamodel-code-generator from 0.25.6 to 0.25.7 by @dependabot in #10507
• Build: Bump datamodel-code-generator from 0.25.7 to 0.25.8 by @dependabot in #10649
• Build: Bump gradle.plugin.io.morethan.jmhreport:gradle-jmh-report from 0.9.0 to 0.9.6 by @dependabot in #10193
• Build: Bump guava from 33.0.0-jre to 33.1.0-jre by @dependabot in #9977
• Build: Bump guava from 33.1.0-jre to 33.2.0-jre by @dependabot in #10271
• Build: Bump guava from 33.2.0-jre to 33.2.1-jre by @dependabot in #10414
• Build: Bump io.airlift:aircompressor from 0.26 to 0.27 by @dependabot in #10383
• Build: Bump io.delta:delta-spark_2.12 from 3.1.0 to 3.2.0 by @dependabot in #10320
• Build: Bump io.delta:delta-standalone_2.12 from 3.1.0 to 3.2.0 by @dependabot in #10321
• Build: Bump io.github.goooler.shadow:shadow-gradle-plugin from 8.1.7 to 8.1.8 by @dependabot in #10612
• Build: Bump io.netty:netty-buffer from 4.1.107.Final to 4.1.108.Final by @dependabot in #10032
• Build: Bump io.netty:netty-buffer from 4.1.108.Final to 4.1.109.Final by @dependabot in #10191
• Build: Bump io.netty:netty-buffer from 4.1.109.Final to 4.1.110.Final by @dependabot in #10384
• Build: Bump io.netty:netty-buffer from 4.1.110.Final to 4.1.111.Final by @dependabot in #10504
• Build: Bump jetty from 9.4.53.v20231009 to 9.4.54.v20240208 by @dependabot in #9982
• Build: Bump jetty from 9.4.54.v20240208 to 9.4.55.v20240627 by @dependabot in #10654
• Build: Bump kafka from 3.6.1 to 3.7.0 by @dependabot in #9855
• Build: Bump kafka from 3.7.0 to 3.7.1 by @dependabot in #10653
• Build: Bump mkdocs-material from 9.5.14 to 9.5.15 by @dependabot in #10031
• Build: Bump mkdocs-material from 9.5.15 to 9.5.17 by @dependabot in #10092
• Build: Bump mkdocs-material from 9.5.17 to 9.5.18 by @dependabot in #10189
• Build: Bump mkdocs-material from 9.5.18 to 9.5.19 by @dependabot in #10241
• Build: Bump mkdocs-material from 9.5.19 to 9.5.21 by @dependabot in #10272
• Build: Bump mkdocs-material from 9.5.21 to 9.5.23 by @dependabot in #10353
• Build: Bump mkdocs-material from 9.5.23 to 9.5.25 by @dependabot in #10413
• Build: Bump mkdocs-material from 9.5.25 to 9.5.26 by @dependabot in #10464
• Build: Bump mkdocs-material from 9.5.26 to 9.5.27 by @dependabot in #10555
• Build: Bump mkdocs-material from 9.5.27 to 9.5.28 by @dependabot in #10648
• Build: Bump mkdocs-material from 9.5.9 to 9.5.14 by @dependabot in #9983
• Build: Bump nessie from 0.77.1 to 0.79.0 by @dependabot in #9976
• Build: Bump nessie from 0.79.0 to 0.80.0 by @dependabot in #10237
• Build: Bump nessie from 0.80.0 to 0.81.1 by @dependabot in #10267
• Build: Bump nessie from 0.81.1 to 0.82.0 by @dependabot in #10318
• Build: Bump nessie from 0.82.0 to 0.83.2 by @dependabot in #10381
• Build: Bump nessie from 0.90.4 to 0.91.1 by @dependabot in #10551
• Build: Bump nessie from 0.91.2 to 0.91.3 by @dependabot in #10608
• Build: Bump nessie from 0.92.0 to 0.92.1 by @dependabot in #10697
• Build: Bump net.snowflake:snow...