Skip to content

feat: support for Spark 4 #589

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 10 commits into
base: main
Choose a base branch
from
Open

feat: support for Spark 4 #589

wants to merge 10 commits into from

Conversation

razvan
Copy link
Member

@razvan razvan commented Jul 9, 2025 •
edited
Loading

Description

Part of: #586

Depends on the corresponding image pr stackabletech/docker-images#1216

Spark 4 is considered experimental because of the following issues:

The integration tests have been updated to exclude spark 4 for the tests known to cause problems.

Definition of Done Checklist

  • Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant
  • Please make sure all these things are done and tick the boxes

Author

  • Changes are OpenShift compatible
  • CRD changes approved
  • CRD documentation for all fields, following the style guide.
  • Helm chart can be installed and deployed operator works
  • Integration tests passed (for non trivial changes)
  • Changes need to be "offline" compatible
  • Links to generated (nightly) docs added
  • Release note snippet added

Reviewer

  • Code contains useful comments
  • Code contains useful logging statements
  • (Integration-)Test cases added
  • Documentation added or updated. Follows the style guide.
  • Changelog updated
  • Cargo.toml only contains references to git tags (not specific commits or branches)

Acceptance

  • Feature Tracker has been updated
  • Proper release label has been added
  • Links to generated (nightly) docs added
  • Release note snippet added
  • Add type/deprecation label & add to the deprecation schedule
  • Add type/experimental label & add to the experimental features tracker

@razvan razvan self-assigned this Jul 9, 2025
razvan and others added 6 commits July 10, 2025 15:33
@razvan
update ny-tlc-report
00fa81c
@stackable-bot @razvan
chore: Generated commit to update templated files since the last temp…
0b1bd1f 
…late run up to stackabletech/operator-templating@e3ffe71 (#590)

Reference-to: stackabletech/operator-templating@e3ffe71 (chore: SDP 25.7 templating updates)
@NickLarsenNZ @razvan
chore: Bump Rust dependencies pre-25.7.0 (#592)
75f9125 
* feat(helm): Add RBAC rule for automatic cluster domain detection

* chore: Bump stackable-operator to 0.94.0 and update other dependencies

* chore: Update changelog

* chore: Add sparkhistory and shs shortnames
@razvan
Merge branch 'main' into feat/spark-4
245b8f9
@razvan
fix the iceberg test
ead8e1e
@razvan
update supported versions
6d7be2e
@razvan razvan mentioned this pull request Jul 23, 2025
Open
6 tasks
@razvan razvan marked this pull request as ready for review July 23, 2025 15:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@razvan razvan

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@razvan @stackable-bot @NickLarsenNZ