Skip to content

Navigation Menu

Appearance settings

Explore
By company size
By use case
By industry
View all solutions
Topics
- AI
- DevOps
- Security
- Software Development
- View all
Explore
- GitHub Sponsors
  Fund open source developers
- The ReadME Project
  GitHub community articles
Repositories
- Enterprise platform
  AI-powered developer platform
Available add-ons
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

redpanda-data / connect Public

Notifications You must be signed in to change notification settings
Fork 874
Star 8.4k

Code
Issues 451
Pull requests 84
Discussions
Actions
Projects
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Discussions
Actions
Projects
Security
Insights

feat(spanner_cdc): single worker Spanner CDC support#3371

Merged

mmatczuk merged 40 commits intomainredpanda-data/connect:mainfrom

mmt/gcp_spannerredpanda-data/connect:mmt/gcp_spannerCopy head branch name to clipboard

Jun 4, 2025

Conversation Commits40 (40)Checks Files changed

Commits

Commits on Jun 4, 2025

spanner_cdc: initial version
mmatczuk
committed
spanner_cdc: clean streams and tables not properly cleaned by tests logic
mmatczuk
committed
spanner_cdc(changestreams): add emulator test harness
mmatczuk
committed
spanner_cdc(changestreams): refactor dialect to use databasepb.DatabaseDialect and add a test
mmatczuk
committed
spanner_cdc(changestreams): improve model
mmatczuk
committed
spanner_cdc(changestreams): refactor Reader for flexibility
mmatczuk
committed
spanner_cdc(changestreams): add metadata store
mmatczuk
committed
spanner_cdc: add metadata_table config option
mmatczuk
committed
spanner_cdc(changestreams): new implementation using persistent metadata store in Spanner
mmatczuk
committed
spanner_cdc(changestreams): reschedule running and scheduled partitions on start
mmatczuk
committed
spanner_cdc(changestreams): extend callback mechanics to allow batching
mmatczuk
committed
internal/ack: add service.AckFunc util that enforces that ack is called once
mmatczuk
committed
spanner_cdc: switch to service.BatchInput
mmatczuk
committed
spanner_cdc: use shutdown.Signaller
mmatczuk
committed
spanner_cdc(changestreams): add min watermark cache
mmatczuk
committed
spanner_cdc: expose min_watermark_cache_ttl
mmatczuk
committed
spanncr_cdc: expose credentials_json
mmatczuk
committed
spanncr_cdc(changestreams): modification type filtering
mmatczuk
committed
spanncr_cdc: expose allowed_mod_types
mmatczuk
committed
spanncr_cdc: fix field declarations and handling
mmatczuk
committed
chore(spanner_cdc): rewrite tests to testify
mmatczuk
committed
spanncr_cdc(changestreams): refactor tests for reusability
mmatczuk
committed
spanncr_cdc(changestreams): return error from Start when partition processing fails
mmatczuk
committed
spanncr_cdc(changestreams): add processing order test based on docs
mmatczuk
committed
chore(spanner_cdc): rename Subscriber.Start() to Run
mmatczuk
committed
spanner_cdc: defer waiting for acks till the end of partition
mmatczuk
committed
spanner_cdc: emit message per DataChangeRecord.Mod item
mmatczuk
committed
spanner_cdc: move all test helper code to changestreamstest and refactor integration test
mmatczuk
committed
chore(spanner_cdc): fix linting errors
mmatczuk
committed
spanner_cdc: do not emit column types and embed Mod
mmatczuk
committed
spanner_cdc(changestreams): trace log SQL queries
mmatczuk
committed
spanner_cdc: new integration tests
mmatczuk
committed
spanner_cdc: add version and CL entry
mmatczuk
committed
chore: bump cloud.google.com/go/spanner to v1.82.0
mmatczuk
committed
chore: bump github.com/googleapis/go-sql-spanner to v1.13.2
mmatczuk
committed
chore(spanner_cdc): rename CheckParentPartitionsFinished to CheckPartitionsFinished
mmatczuk
committed
spanner_cdc(changestreams): cache finished tokens
mmatczuk
committed
spanner_cdc: add metrics
mmatczuk
committed
spanner_cdc: move table name and mod_type to metadata
mmatczuk
committed
spanner_cdc: use MetaSetMut for not string metadata
mmatczuk
committed

Footer

© 2025 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Docs
Contact

You can’t perform that action at this time.