Skip to content

Tracking: sync changes from upstream and drop commits in our fork #31

Open
@xxchan

Description

@xxchan

Guides on maintaining forked dependencies


All commit in our fork:
apache/iceberg-rust@main...risingwavelabs:iceberg-rust:dev_rebase_main_20250325

# Update the following table with this command
# check remotes with `git remove -v` and update the variables below accordingly

REMOTE_RW=rw &&
REMOTE_UPSTREAM=upstream &&
RW_BRANCH=dev_rebase_main_20250325 &&
git fetch --all &&
git log ${REMOTE_UPSTREAM}/main..${REMOTE_RW}/${RW_BRANCH} --oneline | awk '{print "| " $1 " | " substr($0, index($0,$2)) " |"}'
Commit Hash Description Action (What's the PR in upstream?)
15a4686b feat: support update table for memory catalog (#56)
9e9fe264 fix(iceberg): fix compile issue (#55) CAN DROP. INTERNAL MISTAKE
b1619c55 fix(iceberg): fix rewrite-files partition-spec-id (#54)
7c7c84c6 fix(iceberg): pub new function of ArrowReaderBuilder (#53)
eece1b1a feat: exposed file_size_in_bytes (#46)
cf2aeca7 feat(iceberg): support remove expired files (#52)
be339a0b fix(iceberg): Introduce new data sequence for RewriteFilesAction (#51)
8faccbc4 fix: delete file lost wake (#48) DROP. USE apache#982
bc7dec7f feat: expose Error::backtrace() (apache#1352) (#50) DROP apache#1352
4f38d4ae refactor(snapshot): unify ancestors (#49) DROP. internal only
73715f0f feat(iceberg): rewrite files action 0325 (#47)
9c210b91 Merge pull request #45 from risingwavelabs/wcy/azblob_storage apache#1242
79ffb1e0 minor part of above
b429e434 rebase part of above
05f0c947 support azblob storage part of above
14c3387c chore: public function generate_unique_snapshot_id for exactly once sink (#42)
c9da916a fix: cherry-pick #27 (#41)
e6bb6b85 fixup! feat(writer): support partition writer (#16)
c6ac0664 feat: add process delete enrty in snapshot produce (#33)
1f4d225d support merge append (#29) REVERT after #19 and upstream apache#902 merged (STILL OPEN)
82725fd1 feat(iceberg): introduce remove snapshot action (#21)
9efe42b4 feat: add apply in transaction to support stack action (#22)
cd5573af allow specify snapshot id for fast append (#25)(#14)
19660f25 support append delete file (#19) apache#798 (OPEN)
16bb978d feat: expose data file serialized (#26)
fa6caa98 feat: support remove schemas (#20) apache#1115 (MERGED)
d6faf636 feat: support incremental scan between 2 snapshots (#13) apache#1470 (OPEN)
9bef8de0 feat(writer): add delta writer (#18) apache#343 (OPEN)
de08fc87 feat(writer): support partition writer (#16) apache#342 (OPEN)
41e727db feat(writer): add sort position delete writer (#17) apache#704 (OPEN)
849b4fc9 ci: enable ci on PR (#24) ALWAYS KEEP IN FORK

Status Summary (Updated: 2025-06-25)

  • Total commits ahead of upstream: 30 (was 13 in previous update)
  • Commits with known upstream PRs still open: 3 (apache#798, apache#704, apache#902)
  • New commits since last update: 17 commits (from 15a4686 to e6bb6b8)
  • Branch: dev_rebase_main_20250325

Key Changes:

  • Many new features added including Azure Blob storage support, rewrite files action, remove expired files, etc.
  • Several bug fixes and improvements
  • All upstream PRs mentioned in the original issue are still open and under review

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions