Skip to content

Commit 415c412

Browse files
tarofacetaroface
authored
MOLT 1.3.0 notes; --targetApplyQueueSize replicator flag (#19988)
* MOLT 1.3.0 notes; --targetApplyQueueSize replicator flag
1 parent aeeffa6 commit 415c412

File tree

2 files changed

+20
-1
lines changed

2 files changed

+20
-1
lines changed

‎src/current/_includes/molt/replicator-flags.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -30,6 +30,7 @@ The following flags are set with [`--replicator-flags`](#global-flags) and can b
3030
| `--stagingMaxLifetime` | `DURATION` | The maximum lifetime of a database connection.<br><br>**Default:** `5m0s` |
3131
| `--stagingMaxPoolSize` | `INT` | The maximum number of staging database connections.<br><br>**Default:** `128` |
3232
| `--stagingSchema` | `STRING` | Name of the CockroachDB schema that stores replication metadata. **Required** each time [`--mode replication-only`](#replicate-changes) is rerun after being interrupted, as the schema contains a checkpoint table that enables replication to resume from the correct transaction. For details, refer to [Replicate changes](#replicate-changes).<br><br>**Default:** `_replicator.public` |
33+
| `--targetApplyQueueSize` | `INT` | Size of the apply queue that buffers mutations before they are written to the target database. Larger values can improve throughput, but increase memory usage. This flag applies only to CockroachDB and PostgreSQL (`pglogical`) sources, and replaces the deprecated `--copierChannel` and `--stageCopierChannelSize` flags. |
3334
| `--targetConn` | `STRING` | The target database's connection string. |
3435
| `--targetIdleTime` | `DURATION` | Maximum lifetime of an idle connection.<br><br>**Default:** `1m0s` |
3536
| `--targetJitterTime` | `DURATION` | The time over which to jitter database pool disconnections.<br><br>**Default:** `15s` |
@@ -39,7 +40,7 @@ The following flags are set with [`--replicator-flags`](#global-flags) and can b
3940
| `--targetStatementCacheSize` | `INT` | The maximum number of prepared statements to retain.<br><br>**Default:** `128` |
4041
| `--taskGracePeriod` | `DURATION` | How long to allow for task cleanup when recovering from errors.<br><br>**Default:** `1m0s` |
4142
| `--timestampLimit` | `INT` | The maximum number of source timestamps to coalesce into a target transaction.<br><br>**Default:** `1000` |
42-
| `--userscript` | `STRING` | The path to a TypeScript configuration script. For example, `--userscript 'script.ts'`. |
43+
| `--userscript` | `STRING` | The path to a TypeScript configuration script. For example, `--userscript 'script.ts'`. |
4344
| `-v`, `--verbose` | `COUNT` | Increase logging verbosity to `debug`; repeat for `trace`. |
4445

4546
##### PostgreSQL replication flags

‎src/current/releases/molt.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -18,6 +18,24 @@ To download the latest MOLT Fetch/Verify binary:
1818

1919
{% include molt/molt-install.md %}
2020

21+
## July 24, 2025
22+
23+
MOLT Fetch/Verify 1.3.0 is [available](#installation).
24+
25+
- Oracle is now supported on Fetch Docker images and standalone binaries.
26+
- Oracle is now supported on Replicator Docker images and standalone binaries.
27+
- Azure Blob Storage is now supported as an intermediate data store for Fetch.
28+
- Added a `--skip-pk-match` flag that lets you run the initial data load even when the source or target table is missing a primary key, or the keys do not match. When this flag is set, Fetch treats every table as keyless, disables sharding, and exports each table in a single batch, ignoring `export-concurrency` and `row-batch-size`. Querying the entire table at once may lead to high memory usage or long-running queries. Duplicate source rows are automatically removed during import when the target has primary key or unique constraints.
29+
- Replication now uses checkpoint polling by default. This is because polling (which periodically queries the staging table for updates) performs comparably to checkpoint streaming (which uses an internal changefeed from the staging table to broadcast real-time updates). To use checkpoint streaming, set `--enableCheckpointStream`. `--disableCheckpointStream` is deprecated and should be removed from replication commands.
30+
- Replaced the `--copierChannel` and `--stageCopierChannelSize` replication flags with a single `--targetApplyQueueSize` flag, which controls downstream apply throughput and memory usage. This feature applies only to CockroachDB and PostgreSQL (`pglogical`) sources.
31+
- Added support for compressed changefeed payloads, improving performance of changefeed-to-Replicator communication. This only affects failback workflows from CockroachDB v25.2 and later.
32+
- Improved apply-side performance by switching to a faster JSON decoder.
33+
- Improved batch-accumulation performance by removing unnecessary sorting.
34+
35+
#### Bug fixes
36+
37+
- Fixed a bug where some error logs were not displayed when replicating to the target database.
38+
2139
## June 19, 2025
2240

2341
MOLT Fetch/Verify 1.2.7 is [available](#installation).

0 commit comments

Comments
 (0)