Skip to content

Releases: streamingfast/substreams-sink-sql

v4.6.0

21 May 01:12
Compare
Choose a tag to compare
  • Added support for Upsert operation in Postgres, Clickhouse isn't supported right now.

  • Improved batch block flush logic to flush after a certain number of blocks instead of taking by modulo.

  • Fixed cursor loading on Clickhouse.

  • Fixed a bug with not flushing rows on stream completion.

  • Added --clickhouse-cluster flag. If non-empty the sink will apply a ON CLUSTER <cluster> clause when setting up tables and replace table engines with their Replicated counterparts.

  • Added flushed block number and time drift metrics.

v4.5.0

06 Jan 21:06
Compare
Choose a tag to compare
  • Added more flags to configure flushing intervals.

    Available flags are batch-block-flush-interval, batch-row-flush-interval and live-block-flush-interval, check substreams-sink-sql run --help for full documentation about the flags.

v4.4.0

06 Jan 15:05
Compare
Choose a tag to compare
  • Added support for the Clickhouse Date type.

  • Fixed handling of the Clickhouse Array type.

  • Removed the check for duplicate primary keys on the Clickhouse dialect. This allows inserting multiple rows with the same primary key.

v4.3.0

29 Nov 19:23
Compare
Choose a tag to compare
  • Added a check for non-existent columns in Clickhouse
  • Added support for Nullable types in Clickhouse.
  • Bump substreams to v0.11.1
  • Bump substreams-sink to v0.5.0

v4.2.2

07 Nov 20:21
Compare
Choose a tag to compare
  • Fix major bug when receiving empty MapOutput

v4.2.1

13 Sep 21:09
Compare
Choose a tag to compare

DO NOT USE THIS VERSION USE ANYTHING >= v.4.2.2

  • Bump substreams to v1.10.3 to support new manifest data like protobuf:excludePaths

v4.2.0

28 Jun 20:51
Compare
Choose a tag to compare
  • Added the --cursor-table and --history-table flags to allow running to sinks on the same database (be careful that you have no collision in table names)
  • bumped substreams to v1.8.2, add some default network endpoints

v4.0.3

30 Apr 18:48
Compare
Choose a tag to compare
  • Fix another case where 'infinite-retry' would not work and the program would stop on an error.
  • Enable multiple Substreams authentication methods (API key, JWT), using flags --api-key-envvar and --api-token-envvar.
  • Deprecates the use of SF_API_TOKEN environment variable, now use default SUBSTREAMS_API_TOKEN or set your own using --api-token-envvar.

v4.0.2

19 Mar 16:42
Compare
Choose a tag to compare
  • Fixed spurious error reporting when the sinker is terminating or has been canceled.

  • Updated substreams dependency to latest version v1.3.7.

v4.0.1

01 Feb 19:10
Compare
Choose a tag to compare
  • Fixed the timestamp parsing in Clickhouse dialect.
  • Fixed the schema in the tutorial for clickhouse.
  • Add --network flag to override the default value in the manifest or spkg