Handling tombstone events

[kobynet]

I am trying to use the connector for writing postgres CDC data (Debezium connector for PostgreSQL) in parquet format to GCS.

When there is a tombstone record (value is null) then the following error is thrown "Record must have schemas for key and value"

Just for comparison, in confluent s3 connector there is a "behavior.on.null.values" just for that case, does this connector have similar way of handling such scenario?

[Claudenw]

I have done a quick look into the code base. And there may be a work around.

The issue is only found in the topic partition and the topic partition key groupers. If the partition is removed from the file name pattern and \\d+ substituted the partition groupers would not be selected and the null value should be written.