Skip to content

Releases: apache/flink-cdc

release-3.4.0

19 May 02:30
Compare
Choose a tag to compare

Release Announcement

https://flink.apache.org/2025/05/16/apache-flink-cdc-3.4.0-release-announcement/

Release Notes

https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12355589&styleName=&projectId=12315522

Contributors

We would like to express gratitude to all the contributors working on this release:

911432, chenhongyu, ConradJam, Ferenc Csaky, gongzhongqiang, Hang Ruan, He Wang, hiliuxg, Hongshun Wang, Jason Zhang, Jiabao Sun, Junbo Wang, Jzjsnow, Kevin Caesar, Kevin Wang, Kunni, Leonard Xu, lidoudou1993, linjianchang, liuxiaodong, lvyanquan, lzshlzsh, MOBIN-F, moses, North Lin, Olivier, ouyangwulin, Petrichor, proletarians, qinghuanwang, Qingsheng Ren, Robin Moffatt, Runkang He, Sergei Morozov, Seung-Min Lee, Shawn Huang, stayrascal, Thorne, Timi, Umesh Dangat, Vincent-Woo, Vinh Pham, wenmo, Wink, wudi, Xin Gong, yohei yoshimuta, yuanoOo, yuxiqian, zhangzheng

Downloads

We highly recommend all users to upgrade to Flink CDC 3.4.0.

Apache Flink CDC 3.4.0 tar

Apache Flink CDC 3.4.0 (asc, sha512)

Apache Flink CDC 3.4.0 Source Release (asc, sha512)

Pipeline Connectors Jars

  • MySQL Pipeline Connector 3.4.0 (jar, asc, sha1)
  • Doris Pipeline Connector 3.4.0 (jar, asc, sha1)
  • StarRocks Pipeline Connector 3.4.0 (jar, asc, sha1)
  • Kafka Pipeline Connector 3.4.0 (jar, asc, sha1)
  • Paimon Pipeline Connector 3.4.0 (jar, asc, sha1)
  • Elasticsearch Pipeline Connector 3.4.0 (jar, asc, sha1)
  • OceanBase Pipeline Connector 3.4.0 (jar, asc, sha1)
  • MaxCompute Pipeline Connector 3.4.0 (jar, asc, sha1)
  • Iceberg Pipeline Connector 3.4.0 (jar, asc, sha1)

Source Connector Jars

Read more

Release 3.3.0

21 Jan 12:19
Compare
Choose a tag to compare

Release Announcement

https://flink.apache.org/2025/01/21/apache-flink-cdc-3.3.0-release-announcement/

Release Notes

https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12354855

Contributors

We would like to express gratitude to all the contributors working on this release:

ConradJam, Hang Ruan, Hongshun Wang, Jason Zhang, Junbo wang, Jzjsnow, Kunni, Leonard Xu, MOBIN, North Lin, Olivier, Petrichor, Robin Moffatt, Runkang He, Sergei Morozov, Seung-Min Lee, Shawn Huang, Thorne, Timi, Umesh Dangat, Wink, Xin Gong, hiliuxg, liuxiaodong, moses, ouyangwulin, stayrascal, wenmo, wudi, yuanoOo, yuxiqian, MOBIN-F, helloliuxg, jzjsnow, molin.lxd, wuzhiping, zhangchaoming.zcm

Downloads

We highly recommend all users to upgrade to Flink CDC 3.3.0.

Apache Flink CDC 3.3.0 tar

Apache Flink CDC 3.3.0 (asc, sha512)

Apache Flink CDC 3.3.0 Source Release (asc, sha512)

Pipeline Connectors Jars

  • MySQL Pipeline Connector 3.3.0 (jar, asc, sha1)
  • Doris Pipeline Connector 3.3.0 (jar, asc, sha1)
  • StarRocks Pipeline Connector 3.3.0 (jar, asc, sha1)
  • Kafka Pipeline Connector 3.3.0 (jar, asc, sha1)
  • Paimon Pipeline Connector 3.3.0 (jar, asc, sha1)
  • Elasticsearch Pipeline Connector 3.3.0 (jar, asc, sha1)
  • OceanBase Pipeline Connector 3.3.0 (jar, asc, sha1)
  • MaxCompute Pipeline Connector 3.3.0 (jar, asc, sha1)

Source Connector Jars

For more details, check the updated documentation and the release notes. We encourage you to download the release and share your feedback with the community through the Flink mailing lists or JIRA.

Release 3.2.1

27 Nov 08:12
Compare
Choose a tag to compare

Release Announcement

https://flink.apache.org/2024/11/27/apache-flink-cdc-3.2.1-release-announcement/

Release Notes

https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12355099

Contributors

We would like to express gratitude to all the contributors working on this release:

yuxiqian, Xin Gong, Hang Ruan, wudi, qg-lin, Timi988, lvyanquan, ConradJam, Runkang He, Junbo wang, MOBIN, Leonard Xu, Sergei Morozov, liuzeshan

Downloads

We highly recommend all users to upgrade to Flink CDC 3.2.1.

Apache Flink CDC 3.2.1 tar

Apache Flink CDC 3.2.1 (asc, sha512)

Apache Flink CDC 3.2.1 Source Release (asc, sha512)

Pipeline Connectors Jars

  • MySQL Pipeline Connector 3.2.1 (jar, asc, sha1)
  • Doris Pipeline Connector 3.2.1 (jar, asc, sha1)
  • StarRocks Pipeline Connector 3.2.1 (jar, asc, sha1)
  • Kafka Pipeline Connector 3.2.1 (jar, asc, sha1)
  • Paimon Pipeline Connector 3.2.1 (jar, asc, sha1)
  • Elasticsearch Pipeline Connector 3.2.1 (jar, asc, sha1)

Source Connector Jars

For more details, check the updated documentation and the release notes. We encourage you to download the release and share your feedback with the community through the Flink mailing lists or JIRA.

Release 3.2.0

20 Sep 16:31
release-3.2.0
Compare
Choose a tag to compare

Release Announcement

https://flink.apache.org/2024/09/05/apache-flink-cdc-3.2.0-release-announcement/

Release Notes

https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12354594

Contributors

We would like to express gratitude to all the contributors working on this release:

ChengJie1053, ConradJam, FangXiangmin, GOODBOY008, Hang Ruan, He Wang, Hongshun Wang, Jiabao Sun, Joao Boto, Junbo wang, Kunni, Laffery, Leonard Xu, MOBIN, Muhammet Orazov, North Lin, PONYLEE, Paul Lin, Qingsheng Ren, SeungMin, Shawn Huang, Thorne, Wink, Xie Yi, Xin Gong, Zhongmin Qiao, Zmm, gong, gongzhongqiang, hk__lrzy, joyCurry30, lipl, lvyanquan, ouyangwulin, skylines, wuzexian, yanghuaiGit, yux, yuxiqian, ιΌŽζ˜•

Downloads

Apache Flink CDC 3.2.0 tar

Apache Flink CDC 3.2.0 (asc, sha512)

Apache Flink CDC 3.2.0 Source Release (asc, sha512)

Pipeline Connectors Jars

  • MySQL Pipeline Connector 3.2.0 (jar, asc, sha1)
  • Doris Pipeline Connector 3.2.0 (jar, asc, sha1)
  • StarRocks Pipeline Connector 3.2.0 (jar, asc, sha1)
  • Kafka Pipeline Connector 3.2.0 (jar, asc, sha1)
  • Paimon Pipeline Connector 3.2.0 (jar, asc, sha1)
  • Elasticsearch Pipeline Connector 3.2.0 (jar, asc, sha1)

Source Connector Jars

Release 3.1.1

20 Jun 06:18
Compare
Choose a tag to compare

Release Announcement

https://flink.apache.org/2024/06/18/apache-flink-cdc-3.1.1-release-announcement/

Release Notes

https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12354763

Downloads

Apache Flink CDC 3.1.1 tar

Apache Flink CDC 3.1.1 (asc, sha512)

Apache Flink CDC 3.1.1 Source Release (asc, sha512)

Pipeline Connectors Jars

Source Connector Jars

Release 3.1.0

24 May 11:05
Compare
Choose a tag to compare

Release Announcement

https://flink.apache.org/2024/05/17/apache-flink-cdc-3.1.0-release-announcement/

Release Notes

https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12354387

Downloads

Apache Flink CDC 3.1.0 tar

Apache Flink CDC 3.1.0 (asc, sha512)

Apache Flink CDC 3.1.0 Source Release (asc, sha512)

Pipeline Connectors Jars

Source Connector Jars

Release 3.0.1

22 Jan 02:16
Compare
Choose a tag to compare

Release Notes

Documentation: https://ververica.github.io/flink-cdc-connectors/release-3.0

Downloads

Flink CDC

Flink CDC 3.0.1 (tar, asc, sha512)

The binary release can be verified by public key with fingerprint F8822354BF424A5CFF9AFD57BAF388953EF5327A.

Flink CDC Pipeline Connectors

All connectors are release in JAR and available in Maven central repository.

  • Apache Doris pipeline connector 3.0.1 (jar, asc, sha1)
  • MySQL pipeline connector 3.0.1 (jar, asc, sha1)
  • StarRocks pipeline connector 3.0.1 (jar, asc, sha1)
  • Values pipeline connector 3.0.1 (for testing purpose, jar, asc, sha1)

Flink CDC Source Connectors

All connectors are release in JAR and available in Maven central repository.

Improvements and Bug fixes

1.[cdc-base][hotfix] Fix SourceSplitSerializer to get totalFinishedSplitSize from recovery in 4th version
2.[hotfix][cdc-common] Fix NoSuchMethodError of CollectionUtil.newHashMapWithExpectedSize
3.[cdc][e2e] Unify logic to clean docker image when connector e2e test finished (#2978)
4.[pipeline-connector][mysql] fix timestamp with timezone format (#2952)
5.[doc] fix invalid page in website and update yaml in tutorial.
6.[cdc-connector][oracledb] Fix oracle read exceed high_watermark in backfill phase
7.[pipeline-connector][starrocks] Optimize char type mapping for starrocks pipeline connector (#2895)
8.[pipeline-connector][doris][starrocks] Remove SimpleDateFormat for thread safe (#2954)
9.[build] Add github labeler for pipeline connector. (#2851)
10.[docs][cdc-connector][oceanbase] update docker image and os compatibility in quickstart (#2897)
11.[docs] Add Supported Connectors and Supported Flink Versions to Overview. (#2920)
12.[cdc-common][pipeline-doris] Fix typo and wrong value for 'precision' of time type. (#2886)
13.[cdc-connector][mongodb] Avoid mongodb source to read data after high_watermark in backfill phase (#2893)
14.[cdc-connector][oceanbase] Fallback to current timestamp when query gts failure (#2868)
15.[cdc-connector][sqlserver][tests] Fix UT errors by correcting right output (#2864)
16.[cdc] Add Deprecated annotation to source function which connector implemented incremental
17.[hotfix] Remove mysqlToDoris.yml
18.[hotfix] Fix BinaryRecordData deserialize
19.[postgres] Add commits of PostgresConnection back to distinguish with debezium's origin class (#2839)
20.[hotfix][cdc-rumtime][minor] Clean up useless code in BinaryRecordDataSerializer (#2845)
21.[cdc-connector][sqlserver] Fix SqlServerTableSource params order error (#2847)
22.[docs] Fix overview docs to remove prefix of pipeline options (#2833)
23.[3.0][docs] fix mysql pipeline connector option in readme (#2834)

Contributor List (sorted alphabetically)

  1. GOODBOY008
  2. He Wang
  3. Hongshun Wang
  4. joyCurry30
  5. Kunni
  6. Shawn Huang
  7. TorinJie
  8. Xin Gong
  9. gongzhongqiang
  10. xuzifu666
  11. εΌ η”°

Release 3.0.0

07 Dec 03:02
Compare
Choose a tag to compare

Release Notes

Documentation: https://ververica.github.io/flink-cdc-connectors/release-3.0

Downloads

Flink CDC

Flink CDC 3.0.0 (tar, asc, sha512)

The binary release can be verified by public key with fingerprint C460A307EAF2701FC9D774EF96719B746D3D0C8A.

Flink CDC Pipeline Connectors

All connectors are release in JAR and available in Maven central repository.

  • Apache Doris pipeline connector 3.0.0 (jar, asc, sha1)
  • MySQL pipeline connector 3.0.0 (jar, asc, sha1)
  • Starrocks pipeline connector 3.0.0 (jar, asc, sha1)
  • Values pipeline connector 3.0.0 (for testing purpose, jar, asc, sha1)

Flink CDC Source Connectors

All connectors are release in JAR and available in Maven central repository.

Features and Improvements

  1. [pipeline-connector][starrocks] Fix char/varchar length inconsistency between cdc and starrocks (#2830)
  2. [cdc-cli][cdc-composer] Use "source-table" and "sink-table" as keywords of route (#2825)
  3. [build][hotfix] Remove duplicate dependency (#2826)
  4. [cdc-cli][cdc-dist] Support loading global config from FLINK_CDC_HOME (#2822)
  5. [cdc-common][hotfix] Remove redundant prefix of pipeline options (#2821)
  6. [cdc-source-connector][oceanbase][e2e] Add OceanBase e2e test case (#2521)
  7. [build] Use flink-shaded-force-shading to force all submodules to generate dependency-reduced-pom.xml
  8. [build] Use ${project.version} instead of ${revision} for dependency version
  9. [build] Skip maven-deploy-plugin for test modules and flink-cdc-dist
  10. [cdc-pipeline-connector][mysql] Fix precision problem of BIT type conversion (#2820)
  11. [cdc-source-connector][mysql] fix deserialization issue on table metadata binlog event (#2682)
  12. [pipeline-connector][mysql] Remove unnecessary serverTimeZone in DebeziumEventDeserializationSchema (#2816)
  13. [build][hotfix] Remove useless suppressions. (#2817)
  14. [cdc-source-connector][mysql] Fix attempted load of isSuspended in MySqlSplitSerializer::deserializeSplit when cdc version <= 2.2.0 (#2550)
  15. [cdc-pipeline-connector][mysql] Ensure the inference of MEDIUMINT_UNSIGNED type matches INT type in table schema (#2811)
  16. [cdc-connector][oceanbase] Add option for obcdc extra configs (#2543)
  17. [pipeline-connector][mysql] Enable send schema change by default (#2815)
  18. [3.0][cdc-runtime] Remove waitForFlushSuccess field in request handler (#2812)
  19. [pipeline-connector][starrocks] Add starrocks pipeline connector (#2765)
  20. [pipeline-connector][doris] add doris pipeline connector. (#2810)
  21. [cdc-pipeline-connector][mysql] Ensure the precision inference of DECIMAL type matches table schema
  22. [3.0][cdc-common & runtime] Remove useless flink imports
  23. [cdc-pipeline-connector][mysql] Add tests for mysql pipeline connector
  24. [cdc-pipeline-connector][mysql] Support more mysql types
  25. [cdc-pipeleine-connecotr][mysql] Send CreateTableEvent in the mysql pipeline connector
  26. [cdc-pipeline-connector][mysql] Parse the alter statement to generate SchemaChangeEvent
  27. [cdc-pipeline-connector][mysql] Introduce mysql cdc pipeline DataSource
  28. [cdc-cli][cdc-composer][cdc-dist] Support submitting job to general Flink environments (#2807)
  29. [cdc-runtime][hotfix] Setup waitFlushSuccess before responding operator to flush. (#2805)
  30. [cdc-common] Introduce "pipeline.local-time-zone" config option which help handle time zone well (#2797)
  31. [cdc-common][hotfix] Remove useless flink imports (#2803)
  32. [build] Let surefire plugin to keep the full stacktrace on test failure (#2804)
  33. [pipeline-common] Use column name to check whether the schema contains specific column or not. (#2801)
  34. [cdc-composer][route][sink] Add name for route and improve name for sink
  35. [cdc-composer][hotfix] Always chain operator by default
  36. [cdc-composer][sink] Use correct name for sink operator
  37. [cdc-runtime] SchemaRegistry should complete the future after making the checkpoint (#2800)
  38. [cdc-connector][sqlserver][test...
Read more

Release 2.4.2

31 Oct 15:36
Compare
Choose a tag to compare

Release Notes

Documentation: https://ververica.github.io/flink-cdc-connectors/release-2.4

Improvements and Bug fixes

  1. [sqlserver] Fix get latest lsn (#2551)
  2. [sqlserver] Add support bigint type as table split column (#2416)
  3. [hotfix] Fix vitess docker image tag
  4. [e2e] Remove db docker image after test cases are executed. (#2508)
  5. [postgres] Not drop replication slot for stream split (#2436)
  6. [postgres] Close jdbc connection after creating replication slot for stream split (#2425)
  7. [cdc-base] Fix TM hangs caused by uncaught exception (#2511)
  8. [postgres] Close idle readers when snapshot finished (#2400)
  9. [hotfix][mysql] Keep assigned splits in order to fix wrong meta group calculation
  10. [mysql] Add finished unack splits to state for the MysqlSourceReader (#2399)
  11. [cdc-base] Fix parsing error when serializing and deserializing the table name with dot (#2443)
  12. [oracle] Correct the naming error (#2405)
  13. [sqlserver] Add table filter to speed up SqlServerSchema read (#2369)
  14. [hotfix][sqlserver] Fix backfill stream task hang (#2374)
  15. [hotfix][mysql] Trim default value for BIGINT and SMALLINT types when parsing MySQL DDL (#2418)
  16. [Doc] Use redo log instead of binlog in Oracle document (#2408)
  17. [mysql] Filter databases that do not need to be read when discovering tables (#2160)
  18. [test] Fix TiDBE2eITCase by updating the container version to avoid tikv disk full failure (#2402)
  19. [test][postgres] Close postgres containers after tests and fix container reuse bug (#2394)
  20. [mysql] quota the field names when executing mysql query (#2381) (#2388)
  21. [test][mysql] Provide the server-time-zone setting in MySqlSourceExampleTest#testConsumingAllEvents (#2364)
  22. [hotfix][mysql] Catch underlying throwable in snapshot reading.
  23. [hotfix][mysql] Fix failed test LegacyMySqlSourceTest#testSnapshotOnFailedSource (#2384)
  24. [db2] [tests] Fix unstable Db2ConnectorITCase due to cleanup failure
  25. [mongodb][hotfix] Fix SourceRecord range check (#2343)
  26. [polish] Add type parameter for MySqlRecords(#2300)
  27. [doc] fix errors in PostgresParallelSourceExample (#2324)
  28. [docs][oracle] Add an example of Incremental Snapshot based DataStream for Oracle CDC Connector
  29. [mongodb] [tests] Loosen E2E timeout limitations
  30. [build] Add vcs.xml for IDEA (#2064)
  31. [hotfix] update dbz option name 'xx. whitelist' to 'xx.include.list'(xx = database, schema or table) (#2212)

Contributor List (sorted alphabetically)

  1. BIN
  2. FocusComputing
  3. GOODBOY008
  4. Hang Ruan
  5. Hongshun Wang
  6. Jiabao Sun
  7. Kunni
  8. Leonard Xu
  9. Malcolmjian
  10. North.Lin
  11. Paddy Gu
  12. Tyrantlucifer
  13. e-mhui
  14. gongzhongqiang
  15. wuzhenhua
  16. yuxiqian
  17. zhaomin

Release-2.4.1

21 Jul 09:34
Compare
Choose a tag to compare

Release Notes

Documentation: https://ververica.github.io/flink-cdc-connectors/release-2.4

Features and Improvements

  1. [hotfix] Fix sqlserver monitor same table in other database (#2335)
  2. [debezium] Fix DebeizumSourceFunction can not do savepoint after close (#2259)
  3. [mysql] skip closing reader when the reader received the binlog split (#2261)
  4. [MySQL] Optimize how to construct config table.include.list (#2274)
  5. [oracle] Fix class conflict when using multi cdc sql connector
  6. [MySQL] Fix the startup mode exception message (#2264)
  7. [hotfix][mysql] remove unused code (#2231)
  8. [mysql] Fix assigning duplicate snapshot splits when enable scan newly added tables (#2326)
  9. [docs] Add connector features table to help users quickly understand the supported features of each connector
  10. [mysql] Remove the finished snapshot splits for the binlog split when restoring from the checkpoint (#2292) (#2318)
  11. [hotfix][sqlserver] Fix sqlserver close idle and chunk key column missing (#2310)
  12. [docs] Update Postgres CDC document for slot.name option (#2280)
  13. [postgres] Fix the slot name conflict bug (#2251)
  14. [docs] add docs for the mysql tables without primary keys (#2238)
  15. [oracle] Use oracle connection in context for each reader subtask (#2254)
  16. [hotfix] Update support version (#2256)

Contributor List (sorted alphabetically)

  1. Hang Ruan
  2. Leonard Xu
  3. SileiWu
  4. empcl
  5. gongzhongqiang
  6. skylines
  7. syyfffy