Skip to content

Release 5.1.5 #63

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
Oct 30, 2024
Merged

Release 5.1.5 #63

merged 9 commits into from
Oct 30, 2024

Conversation

Emrehzl94
Copy link
Contributor

No description provided.

added payload mode documentation
@Emrehzl94 Emrehzl94 requested a review from nvitucci October 29, 2024 13:00
Emrehzl94 and others added 3 commits October 29, 2024 14:08
Co-authored-by: Florent Biville <445792+fbiville@users.noreply.github.com>
Co-authored-by: Florent Biville <445792+fbiville@users.noreply.github.com>
Co-authored-by: Florent Biville <445792+fbiville@users.noreply.github.com>
@fbiville fbiville self-requested a review October 29, 2024 13:12
Copy link
Contributor

@ali-ince ali-ince left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shall we also add a bullet point in What's New page?


== Compatibility with Sink Connectors

The `EXTENDED` format was introduced in connector version 5.1.0 to ensure that all data published to Kafka topics adheres to a consistent schema. This prevents issues when a property changes type on the Neo4j side (e.g., a name property changes from integer to string), enabling smooth data processing across connectors and Kafka consumers.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we also mention that if there is a Neo4j sink connector instance which is fed from a Neo4j source connector, they should stick with EXTENDED mode.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sure 👍

Emrehzl94 and others added 2 commits October 30, 2024 09:38
Co-authored-by: Ali Ince <ali-ince@users.noreply.github.com>
@neo-technology-commit-status-publisher
Copy link
Collaborator

neo-technology-commit-status-publisher commented Oct 30, 2024

Thanks for the documentation updates.

The preview documentation has now been torn down - reopening this PR will republish it.


== Compatibility with Sink Connectors

The `EXTENDED` format was introduced in connector version 5.1.0 to ensure that all data published to Kafka topics adheres to a consistent schema. This prevents issues when a property changes type on the Neo4j side (e.g., a name property changes from integer to string), enabling smooth data processing across connectors and Kafka consumers. When a Neo4j sink connector is fed by a Neo4j source connector, it’s recommended to use `EXTENDED` mode, as the Neo4j sink connector can seamlessly handle the `EXTENDED` data type.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do COMPACT source data work with sinks in some circumstances?
if it never works, I'd use stronger language in the last sentence. Something like "EXTENDED mode must be used with sinks..."

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, you can use it as long as you comply with COMPACT mode limitations like preventing property type changes and temporal types for protobuf

Copy link
Contributor

@ali-ince ali-ince left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Emrehzl94 Emrehzl94 merged commit a8ad063 into neo4j:main Oct 30, 2024
5 checks passed
@Emrehzl94 Emrehzl94 deleted the release-5.1.5 branch October 30, 2024 15:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants