Skip to content

Commit 3341ad9

Browse files
Joel-hansonJoel Hanson
authored andcommitted
feat: Update package versions and fix vulnerabilities
- updated pom.xml to latest version - updated xml format to be more consistent - updated Dockerfile to use latest version of kafka - New Dockerfile with updated versions of the base image and the packages installed in the image. - java distribution and pom package version updates - Update java distribution to semeru from temurin - Update com.ibm.mq.allclient to 9.3.2.1 to fix SNYK-JAVA-ORGJSON-5488379 - Update mockito-core to 4.11.0 to support java 8 - Update mq and kafka version support in README.md - Update version from 1.3.3 to 1.3.4 Signed-off-by: Joel Hanson <joelhanson025@gmail.com>
1 parent 724eabc commit 3341ad9

File tree

6 files changed

+327
-281
lines changed

6 files changed

+327
-281
lines changed

.github/ISSUE_TEMPLATE/BUG-REPORT.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -57,8 +57,8 @@ body:
5757
label: Version
5858
description: What version of our software are you running?
5959
options:
60-
- 1.3.3 (Default)
61-
- older (<1.3.3)
60+
- 1.3.4 (Default)
61+
- older (<1.3.4)
6262
validations:
6363
required: true
6464
- type: textarea

.github/workflows/checkstyle-and-tests.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ jobs:
1717
uses: actions/setup-java@v3
1818
with:
1919
java-version: 8
20-
distribution: 'temurin'
20+
distribution: 'semeru'
2121
- name: Get java-version
2222
run: |
2323
BUILD_VERSION=$( mvn help:evaluate -Dexpression=project.version -q -DforceStdout )

Dockerfile

Lines changed: 14 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,16 +1,25 @@
1-
FROM strimzi/kafka:latest-kafka-2.6.0 as builder
1+
# This dockerfile expects Connector jars to have been built under a `connectors` directory
2+
#
3+
FROM alpine as builder
24

3-
FROM ibmjava:8-jre
5+
RUN apk update
6+
RUN apk --no-cache add curl
7+
8+
RUN curl -L "https://downloads.apache.org/kafka/3.4.0/kafka_2.12-3.4.0.tgz" -o kafka.tgz
9+
RUN mkdir /opt/kafka \
10+
&& tar -xf kafka.tgz -C /opt/kafka --strip-components=1
11+
12+
FROM ibmjava:11
413

514
RUN addgroup --gid 5000 --system esgroup && \
615
adduser --uid 5000 --ingroup esgroup --system esuser
716

817
COPY --chown=esuser:esgroup --from=builder /opt/kafka/bin/ /opt/kafka/bin/
918
COPY --chown=esuser:esgroup --from=builder /opt/kafka/libs/ /opt/kafka/libs/
10-
COPY --chown=esuser:esgroup --from=builder /opt/kafka/config/connect-distributed.properties /opt/kafka/config/
11-
COPY --chown=esuser:esgroup --from=builder /opt/kafka/config/connect-log4j.properties /opt/kafka/config/
19+
COPY --chown=esuser:esgroup --from=builder /opt/kafka/config/ /opt/kafka/config/
1220
RUN mkdir /opt/kafka/logs && chown esuser:esgroup /opt/kafka/logs
13-
COPY --chown=esuser:esgroup target/kafka-connect-mq-source-1.3.3-jar-with-dependencies.jar /opt/kafka/libs/
21+
22+
COPY --chown=esuser:esgroup target/kafka-connect-*-jar-with-dependencies.jar /opt/connectors
1423

1524
WORKDIR /opt/kafka
1625

README.md

Lines changed: 8 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -46,7 +46,7 @@ Build the connector using Maven:
4646
mvn clean package
4747
```
4848

49-
Once built, the output is a single JAR called `target/kafka-connect-mq-source-<version>-jar-with-dependencies.jar` which contains all of the required dependencies.
49+
Once built, the output is a single JAR called `target/kafka-connect-mq-source-<VERSION>-jar-with-dependencies.jar` which contains all of the required dependencies.
5050

5151
## Running the connector
5252

@@ -59,8 +59,8 @@ To run the connector, you must have:
5959

6060
- The JAR from building the connector
6161
- A properties file containing the configuration for the connector
62-
- Apache Kafka 2.0.0 or later, either standalone or included as part of an offering such as IBM Event Streams
63-
- IBM MQ v8 or later, or the IBM MQ on Cloud service
62+
- Apache Kafka 2.6.2 or later, either standalone or included as part of an offering such as IBM Event Streams
63+
- IBM MQ v9 or later, or the IBM MQ on Cloud service
6464

6565
The connector can be run in a Kafka Connect worker in either standalone (single process) or distributed mode. It's a good idea to start in standalone mode.
6666

@@ -92,13 +92,15 @@ curl -X POST -H "Content-Type: application/json" http://localhost:8083/connector
9292
This repository includes an example Dockerfile to run Kafka Connect in distributed mode. It also adds in the MQ source connector as an available connector plugin. It uses the default `connect-distributed.properties` and `connect-log4j.properties` files.
9393

9494
1. `mvn clean package`
95-
1. `docker build -t kafkaconnect-with-mq-source:1.3.3 .`
96-
1. `docker run -p 8083:8083 kafkaconnect-with-mq-source:1.3.3`
95+
1. `docker build -t kafkaconnect-with-mq-source:<TAG> .`
96+
1. `docker run -p 8083:8083 kafkaconnect-with-mq-source:<TAG>`
97+
98+
Substitute `<TAG>` with the version of the connector or `latest` to use the latest version.
9799

98100
**NOTE:** To provide custom properties files create a folder called `config` containing the `connect-distributed.properties` and `connect-log4j.properties` files and use a Docker volume to make them available when running the container like this:
99101

100102
``` shell
101-
docker run -v $(pwd)/config:/opt/kafka/config -p 8083:8083 kafkaconnect-with-mq-source:1.3.3
103+
docker run -v $(pwd)/config:/opt/kafka/config -p 8083:8083 kafkaconnect-with-mq-source:<TAG>
102104
```
103105

104106
To start the MQ connector, you can use `config/mq-source.json` in this repository after replacing all placeholders and use a command like this:

0 commit comments

Comments
 (0)