Skip to content

Adapt tests & docs with 4.0.1 #579

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Mar 12, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,11 +10,13 @@ All notable changes to this project will be documented in this file.
- Aggregate emitted Kubernetes events on the CustomResources ([#560]).
- Support configuring JVM arguments ([#572]).
- Support for S3 region ([#574]).
- Support for version `4.0.1` as LTS ([#579]).

### Changed

- Default to OCI for image metadata and product image selection ([#561]).
- Increase default memory reservation to `768Mi` to avoid `OOMKilled` ([#578]).
- Deprecated version `4.0.0` ([#579]).

### Fixed

Expand All @@ -31,6 +33,7 @@ All notable changes to this project will be documented in this file.
[#572]: https://github.com/stackabletech/hive-operator/pull/572
[#574]: https://github.com/stackabletech/hive-operator/pull/574
[#578]: https://github.com/stackabletech/hive-operator/pull/578
[#579]: https://github.com/stackabletech/hive-operator/pull/579

## [24.11.1] - 2025-01-10

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ metadata:
name: hive-postgres-s3
spec:
image:
productVersion: 4.0.0
productVersion: 4.0.1
clusterConfig:
database:
connString: jdbc:postgresql://postgresql:5432/hive
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ metadata:
name: hive-postgres-s3
spec:
image:
productVersion: 4.0.0
productVersion: 4.0.1
clusterConfig:
database:
connString: jdbc:postgresql://postgresql:5432/hive
Expand Down
10 changes: 5 additions & 5 deletions docs/modules/hive/pages/usage-guide/database-driver.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,7 @@ metadata:
name: hive-with-drivers
spec:
image:
productVersion: 4.0.0
productVersion: 4.0.1
clusterConfig:
database:
connString: jdbc:mysql://mysql:3306/hive # <1>
Expand Down Expand Up @@ -195,15 +195,15 @@ If you have access to a registry to store custom images, another approach is to
.Copy the driver
[source]
----
FROM oci.stackable.tech/sdp/hive:4.0.0-stackable0.0.0-dev
FROM oci.stackable.tech/sdp/hive:4.0.1-stackable0.0.0-dev

RUN curl --fail -L https://repo1.maven.org/maven2/com/mysql/mysql-connector-j/8.0.31/mysql-connector-j-8.0.31.jar -o /stackable/mysql-connector-j-8.0.31.jar
----

.Build and tag the image
[source]
----
docker build -f ./Dockerfile -t oci.stackable.tech/sdp/hive:4.0.0-stackable0.0.0-dev-mysql .
docker build -f ./Dockerfile -t oci.stackable.tech/sdp/hive:4.0.1-stackable0.0.0-dev-mysql .
----

.Reference the new path to the driver without the need for using a volume mounted from a PVC
Expand All @@ -216,8 +216,8 @@ metadata:
name: hive
spec:
image:
custom: oci.stackable.tech/sdp/hive:4.0.0-stackable0.0.0-dev-mysql # <1>
productVersion: 4.0.0
custom: oci.stackable.tech/sdp/hive:4.0.1-stackable0.0.0-dev-mysql # <1>
productVersion: 4.0.1
clusterConfig:
database:
...
Expand Down
8 changes: 4 additions & 4 deletions docs/modules/hive/pages/usage-guide/derby-example.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ metadata:
name: simple-hive-derby
spec:
image:
productVersion: 4.0.0
productVersion: 4.0.1
clusterConfig:
database:
connString: jdbc:derby:;databaseName=/tmp/metastore_db;create=true
Expand All @@ -39,7 +39,7 @@ stringData:

WARNING: You should not use the `Derby` database in production. Derby stores data locally which does not work in high availability setups (multiple replicas) and all data is lost after Pod restarts.

To create a single node Apache Hive Metastore (v4.0.0) cluster with derby and S3 access, deploy a minio (or use any available S3 bucket):
To create a single node Apache Hive Metastore (v4.0.1) cluster with derby and S3 access, deploy a minio (or use any available S3 bucket):
[source,bash]
----
helm install minio \
Expand All @@ -66,7 +66,7 @@ metadata:
name: simple-hive-derby
spec:
image:
productVersion: 4.0.0
productVersion: 4.0.1
clusterConfig:
database:
connString: jdbc:derby:;databaseName=/stackable/metastore_db;create=true
Expand Down Expand Up @@ -143,7 +143,7 @@ metadata:
name: simple-hive-postgres
spec:
image:
productVersion: 4.0.0
productVersion: 4.0.1
clusterConfig:
database:
connString: jdbc:postgresql://hive-postgresql.default.svc.cluster.local:5432/hive
Expand Down
4 changes: 2 additions & 2 deletions docs/modules/hive/partials/supported-versions.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -2,5 +2,5 @@
// This is a separate file, since it is used by both the direct Hive-Operator documentation, and the overarching
// Stackable Platform documentation.

- 3.1.3 (LTS)
- 4.0.0 (experimental)
- 4.0.1 (LTS)
- 3.1.3 (deprecated)
2 changes: 1 addition & 1 deletion examples/simple-hive-cluster-postgres-s3.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ metadata:
name: simple-hive-postgres
spec:
image:
productVersion: 4.0.0
productVersion: 4.0.1
stackableVersion: 0.0.0-dev
clusterConfig:
database:
Expand Down
2 changes: 1 addition & 1 deletion examples/simple-hive-cluster.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ metadata:
name: simple-hive-derby
spec:
image:
productVersion: 4.0.0
productVersion: 4.0.1
stackableVersion: 0.0.0-dev
clusterConfig:
database:
Expand Down
4 changes: 2 additions & 2 deletions rust/operator-binary/src/config/jvm.rs
Original file line number Diff line number Diff line change
Expand Up @@ -104,7 +104,7 @@ mod tests {
name: simple-hive
spec:
image:
productVersion: 4.0.0
productVersion: 4.0.1
clusterConfig:
database:
connString: jdbc:derby:;databaseName=/tmp/hive;create=true
Expand Down Expand Up @@ -139,7 +139,7 @@ mod tests {
name: simple-hive
spec:
image:
productVersion: 4.0.0
productVersion: 4.0.1
clusterConfig:
database:
connString: jdbc:derby:;databaseName=/tmp/hive;create=true
Expand Down
2 changes: 1 addition & 1 deletion rust/operator-binary/src/crd/affinity.rs
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ mod tests {
name: simple-hive
spec:
image:
productVersion: 4.0.0
productVersion: 4.0.1
clusterConfig:
database:
connString: jdbc:derby:;databaseName=/tmp/hive;create=true
Expand Down
14 changes: 7 additions & 7 deletions tests/test-definition.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -17,28 +17,28 @@ dimensions:
- name: hive
values:
- 3.1.3
- 4.0.0
- 4.0.1
# Alternatively, if you want to use a custom image, append a comma and the full image name to the product version
# as in the example below.
# - 4.0.0,oci.stackable.tech/sandbox/hive:4.0.0-stackable0.0.0-dev
# - 4.0.1,oci.stackable.tech/sandbox/hive:4.0.1-stackable0.0.0-dev
- name: hive-latest
values:
- 4.0.0
- 4.0.1
# Alternatively, if you want to use a custom image, append a comma and the full image name to the product version
# as in the example below.
# - 4.0.0,oci.stackable.tech/sandbox/hive:4.0.0-stackable0.0.0-dev
# - 4.0.1,oci.stackable.tech/sandbox/hive:4.0.1-stackable0.0.0-dev
- name: hive-old
values:
- 3.1.3
- name: hive-new
values:
- 4.0.0
- 4.0.1
- name: hdfs-latest
values:
- 3.4.0
- 3.4.1
- name: zookeeper-latest
values:
- 3.9.2
- 3.9.3
- name: krb5
values:
- 1.21.1
Expand Down