Skip to content

Conversation

@jrosend
Copy link

@jrosend jrosend commented Oct 7, 2025

What's being changed

Pulling upstream of OpenLineage opensource code, up to version 1.38.0 (currently 1.23.0)

kacpermuda and others added 30 commits May 19, 2025 15:08
…rmer (OpenLineage#3706)

Signed-off-by: Kacper Muda <mudakacper@gmail.com>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
Signed-off-by: Maciej Obuchowski <maciej.obuchowski@datadoghq.com>
Signed-off-by: Maciej Obuchowski <maciej.obuchowski@datadoghq.com>
Signed-off-by: Maciej Obuchowski <maciej.obuchowski@datadoghq.com>
…ates (OpenLineage#3705)

Bumps the client-java group with 8 updates in the /client/java directory:

| Package | From | To |
| --- | --- | --- |
| [io.micrometer:micrometer-core](https://github.com/micrometer-metrics/micrometer) | `1.14.6` | `1.15.0` |
| [io.micrometer:micrometer-registry-statsd](https://github.com/micrometer-metrics/micrometer) | `1.14.6` | `1.15.0` |
| [com.google.cloud:google-cloud-datalineage](https://github.com/googleapis/google-cloud-java) | `0.54.0` | `0.55.0` |
| software.amazon.awssdk:bom | `2.31.40` | `2.31.45` |
| com.adobe.testing:s3mock-testcontainers | `4.2.0` | `4.3.0` |
| software.amazon.awssdk:auth | `2.31.15` | `2.31.45` |
| software.amazon.awssdk:datazone | `2.31.15` | `2.31.45` |
| software.amazon.awssdk:apache-client | `2.31.15` | `2.31.45` |



Updates `io.micrometer:micrometer-core` from 1.14.6 to 1.15.0
- [Release notes](https://github.com/micrometer-metrics/micrometer/releases)
- [Commits](micrometer-metrics/micrometer@v1.14.6...v1.15.0)

Updates `io.micrometer:micrometer-registry-statsd` from 1.14.6 to 1.15.0
- [Release notes](https://github.com/micrometer-metrics/micrometer/releases)
- [Commits](micrometer-metrics/micrometer@v1.14.6...v1.15.0)

Updates `io.micrometer:micrometer-registry-statsd` from 1.14.6 to 1.15.0
- [Release notes](https://github.com/micrometer-metrics/micrometer/releases)
- [Commits](micrometer-metrics/micrometer@v1.14.6...v1.15.0)

Updates `com.google.cloud:google-cloud-datalineage` from 0.54.0 to 0.55.0
- [Release notes](https://github.com/googleapis/google-cloud-java/releases)
- [Changelog](https://github.com/googleapis/google-cloud-java/blob/main/CHANGELOG.md)
- [Commits](googleapis/google-cloud-java@v0.54.0...v0.55.0)

Updates `software.amazon.awssdk:bom` from 2.31.40 to 2.31.45

Updates `com.adobe.testing:s3mock-testcontainers` from 4.2.0 to 4.3.0

Updates `software.amazon.awssdk:auth` from 2.31.15 to 2.31.45

Updates `software.amazon.awssdk:datazone` from 2.31.15 to 2.31.45

Updates `software.amazon.awssdk:apache-client` from 2.31.15 to 2.31.45

Updates `software.amazon.awssdk:datazone` from 2.31.15 to 2.31.45

Updates `software.amazon.awssdk:apache-client` from 2.31.15 to 2.31.45

---
updated-dependencies:
- dependency-name: io.micrometer:micrometer-core
  dependency-version: 1.15.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: client-java
- dependency-name: io.micrometer:micrometer-registry-statsd
  dependency-version: 1.15.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: client-java
- dependency-name: io.micrometer:micrometer-registry-statsd
  dependency-version: 1.15.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: client-java
- dependency-name: com.google.cloud:google-cloud-datalineage
  dependency-version: 0.55.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: client-java
- dependency-name: software.amazon.awssdk:bom
  dependency-version: 2.31.45
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
- dependency-name: com.adobe.testing:s3mock-testcontainers
  dependency-version: 4.3.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: client-java
- dependency-name: software.amazon.awssdk:auth
  dependency-version: 2.31.45
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
- dependency-name: software.amazon.awssdk:datazone
  dependency-version: 2.31.45
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
- dependency-name: software.amazon.awssdk:apache-client
  dependency-version: 2.31.45
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
- dependency-name: software.amazon.awssdk:datazone
  dependency-version: 2.31.45
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
- dependency-name: software.amazon.awssdk:apache-client
  dependency-version: 2.31.45
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Pawel Leszczynski <leszczynski.pawel@gmail.com>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
* add hive integration

Co-authored-by: Dominik Dębowczyk <dominik.debowczyk@getindata.com>
Co-authored-by: Julien Phalip <jphalip@google.com>

Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>

* bump the OL version to match the rest of the project

Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>

* remove redundant gcp lineage dependency

Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>

* remove gcp lineage imports

Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>

* spotless

Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>

* add info about passing client properties

Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>

* change event time init

Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>

---------

Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>
Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>
Signed-off-by: Pawel Leszczynski <leszczynski.pawel@gmail.com>
* add new symlink type

Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>

* changelog update

Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>

* update symlink type values in hive integration tests

Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>

* fix type in test

Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>

---------

Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>
Signed-off-by: Maciej Obuchowski <maciej.obuchowski@datadoghq.com>
OpenLineage#3718)

Bumps the client-java group in /client/java with 9 updates:

| Package | From | To |
| --- | --- | --- |
| [org.apache.httpcomponents.client5:httpclient5](https://github.com/apache/httpcomponents-client) | `5.4.4` | `5.5` |
| [org.mockito:mockito-core](https://github.com/mockito/mockito) | `5.17.0` | `5.18.0` |
| [org.mockito:mockito-junit-jupiter](https://github.com/mockito/mockito) | `5.17.0` | `5.18.0` |
| [com.google.cloud:google-cloud-storage](https://github.com/googleapis/java-storage) | `2.52.2` | `2.52.3` |
| [com.google.cloud:google-cloud-nio](https://github.com/googleapis/java-storage-nio) | `0.127.35` | `0.127.36` |
| software.amazon.awssdk:bom | `2.31.45` | `2.31.50` |
| software.amazon.awssdk:auth | `2.31.45` | `2.31.50` |
| software.amazon.awssdk:datazone | `2.31.45` | `2.31.50` |
| software.amazon.awssdk:apache-client | `2.31.45` | `2.31.50` |


Updates `org.apache.httpcomponents.client5:httpclient5` from 5.4.4 to 5.5
- [Changelog](https://github.com/apache/httpcomponents-client/blob/master/RELEASE_NOTES.txt)
- [Commits](apache/httpcomponents-client@rel/v5.4.4...rel/v5.5)

Updates `org.mockito:mockito-core` from 5.17.0 to 5.18.0
- [Release notes](https://github.com/mockito/mockito/releases)
- [Commits](mockito/mockito@v5.17.0...v5.18.0)

Updates `org.mockito:mockito-junit-jupiter` from 5.17.0 to 5.18.0
- [Release notes](https://github.com/mockito/mockito/releases)
- [Commits](mockito/mockito@v5.17.0...v5.18.0)

Updates `org.mockito:mockito-junit-jupiter` from 5.17.0 to 5.18.0
- [Release notes](https://github.com/mockito/mockito/releases)
- [Commits](mockito/mockito@v5.17.0...v5.18.0)

Updates `com.google.cloud:google-cloud-storage` from 2.52.2 to 2.52.3
- [Release notes](https://github.com/googleapis/java-storage/releases)
- [Changelog](https://github.com/googleapis/java-storage/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-storage@v2.52.2...v2.52.3)

Updates `com.google.cloud:google-cloud-nio` from 0.127.35 to 0.127.36
- [Release notes](https://github.com/googleapis/java-storage-nio/releases)
- [Changelog](https://github.com/googleapis/java-storage-nio/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-storage-nio@v0.127.35...v0.127.36)

Updates `software.amazon.awssdk:bom` from 2.31.45 to 2.31.50

Updates `software.amazon.awssdk:auth` from 2.31.45 to 2.31.50

Updates `software.amazon.awssdk:datazone` from 2.31.45 to 2.31.50

Updates `software.amazon.awssdk:apache-client` from 2.31.45 to 2.31.50

Updates `software.amazon.awssdk:datazone` from 2.31.45 to 2.31.50

Updates `software.amazon.awssdk:apache-client` from 2.31.45 to 2.31.50

---
updated-dependencies:
- dependency-name: org.apache.httpcomponents.client5:httpclient5
  dependency-version: '5.5'
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: client-java
- dependency-name: org.mockito:mockito-core
  dependency-version: 5.18.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: client-java
- dependency-name: org.mockito:mockito-junit-jupiter
  dependency-version: 5.18.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: client-java
- dependency-name: org.mockito:mockito-junit-jupiter
  dependency-version: 5.18.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: client-java
- dependency-name: com.google.cloud:google-cloud-storage
  dependency-version: 2.52.3
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
- dependency-name: com.google.cloud:google-cloud-nio
  dependency-version: 0.127.36
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
- dependency-name: software.amazon.awssdk:bom
  dependency-version: 2.31.50
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
- dependency-name: software.amazon.awssdk:auth
  dependency-version: 2.31.50
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
- dependency-name: software.amazon.awssdk:datazone
  dependency-version: 2.31.50
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
- dependency-name: software.amazon.awssdk:apache-client
  dependency-version: 2.31.50
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
- dependency-name: software.amazon.awssdk:datazone
  dependency-version: 2.31.50
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
- dependency-name: software.amazon.awssdk:apache-client
  dependency-version: 2.31.50
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: client-java
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
OpenLineage#3728)

- Add deepCopy utility method to OpenLineageClientUtils for safe object cloning
- Modify TransformTransport to create deep copies of events before transformation

Signed-off-by: Jakub Dardzinski <kuba0221@gmail.com>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
Signed-off-by: merobi-hub <merobi@gmail.com>
…penLineage#3749)

Signed-off-by: Maciej Obuchowski <maciej.obuchowski@datadoghq.com>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
Signed-off-by: Martynov Maxim <martinov_m_s_@mail.ru>
EugeneYushin and others added 18 commits September 14, 2025 16:47
Signed-off-by: EugenYushin <evgenij.ushin@gmail.com>
Signed-off-by: Kacper Muda <mudakacper@gmail.com>
…log properties (OpenLineage#4039)

Signed-off-by: Dominik Dębowczyk <dominik.debowczyk@getindata.com>
…Lineage#4042)

* feat(website): add Pentaho Data Catalog as OpenLineage consumer

Signed-off-by: hhenriqueferreira <henrique.ferreira@hitachivantara.com>

* chore(website): adjust Pentaho logo margins for 300x150 SVG

Signed-off-by: hhenriqueferreira <henrique.ferreira@hitachivantara.com>

* chore(website): point consumer to SVG and remove old PNG

Signed-off-by: hhenriqueferreira <henrique.ferreira@hitachivantara.com>

---------

Signed-off-by: hhenriqueferreira <henrique.ferreira@hitachivantara.com>
Signed-off-by: Pawel Leszczynski <leszczynski.pawel@gmail.com>
…penLineage#4044)

* extend test cases to reproduce the issue

Signed-off-by: EugenYushin <evgenij.ushin@gmail.com>

* fix path conditionals

Signed-off-by: EugenYushin <evgenij.ushin@gmail.com>

* rely on either temporaryGcsBucket or persistentGcsBucket

Signed-off-by: EugenYushin <evgenij.ushin@gmail.com>

* Revert "rely on either temporaryGcsBucket or persistentGcsBucket"

This reverts commit 5fe000f.

Signed-off-by: EugenYushin <evgenij.ushin@gmail.com>

* rollback to path check

Signed-off-by: EugenYushin <evgenij.ushin@gmail.com>

---------

Signed-off-by: EugenYushin <evgenij.ushin@gmail.com>
PR OpenLineage#4031 introduced changes to CLL that would fail when
running in runtimes without spark-hive package included.
This adjusts the code to make it work even without spark-hive.

Signed-off-by: kchledowski <github@chledowski.com>
Signed-off-by: Kacper Muda <mudakacper@gmail.com>
Signed-off-by: Maciej Obuchowski <maciej.obuchowski@datadoghq.com>
Signed-off-by: Maciej Obuchowski <maciej.obuchowski@datadoghq.com>
…dates (OpenLineage#4054)

Bumps the client-java group with 22 updates in the /client/java directory:

| Package | From | To |
| --- | --- | --- |
| org.apache.commons:commons-lang3 | `3.18.0` | `3.19.0` |
| [org.apache.httpcomponents.client5:httpclient5](https://github.com/apache/httpcomponents-client) | `5.5` | `5.5.1` |
| [io.micrometer:micrometer-core](https://github.com/micrometer-metrics/micrometer) | `1.15.2` | `1.15.4` |
| [io.micrometer:micrometer-registry-statsd](https://github.com/micrometer-metrics/micrometer) | `1.15.2` | `1.15.4` |
| org.apache.kafka:kafka-clients | `4.0.0` | `4.1.0` |
| [org.projectlombok:lombok](https://github.com/projectlombok/lombok) | `1.18.38` | `1.18.42` |
| [org.assertj:assertj-core](https://github.com/assertj/assertj) | `3.27.3` | `3.27.6` |
| [org.junit.jupiter:junit-jupiter](https://github.com/junit-team/junit-framework) | `5.13.3` | `5.13.4` |
| [org.mockito:mockito-core](https://github.com/mockito/mockito) | `5.18.0` | `5.20.0` |
| [org.mockito:mockito-junit-jupiter](https://github.com/mockito/mockito) | `5.18.0` | `5.20.0` |
| [com.google.guava:guava](https://github.com/google/guava) | `33.4.8-jre` | `33.5.0-jre` |
| [com.gradleup.shadow](https://github.com/GradleUp/shadow) | `8.3.8` | `9.2.2` |
| [io.freefair.lombok](https://github.com/freefair/gradle-plugins) | `8.14` | `9.0.0` |
| [com.google.cloud:google-cloud-datalineage](https://github.com/googleapis/google-cloud-java) | `0.60.0` | `0.67.0` |
| [com.google.cloud:google-cloud-storage](https://github.com/googleapis/java-storage) | `2.53.3` | `2.58.0` |
| [com.google.cloud:google-cloud-nio](https://github.com/googleapis/java-storage-nio) | `0.128.0` | `0.128.5` |
| software.amazon.awssdk:bom | `2.32.4` | `2.34.5` |
| com.adobe.testing:s3mock-testcontainers | `4.6.0` | `4.9.1` |
| [com.github.gmazzo.buildconfig](https://github.com/gmazzo/gradle-buildconfig-plugin) | `5.6.7` | `5.6.8` |
| software.amazon.awssdk:auth | `2.32.4` | `2.34.5` |
| software.amazon.awssdk:datazone | `2.32.4` | `2.34.5` |
| software.amazon.awssdk:apache-client | `2.32.4` | `2.34.5` |
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Maciej Obuchowski <maciej.obuchowski@datadoghq.com>
* Fix: false hive glue detection due to always attempting Glue ARN resolution

Signed-off-by: jsjasonseba <jsjasonseba@gmail.com>

* test: add PathUtilstest for catalog table with hive metastore on S3

Signed-off-by: jsjasonseba <jsjasonseba@gmail.com>

---------

Signed-off-by: jsjasonseba <jsjasonseba@gmail.com>
Signed-off-by: kchledowski <github@chledowski.com>
Signed-off-by: Maciej Obuchowski <maciej.obuchowski@datadoghq.com>
Signed-off-by: Maciej Obuchowski <maciej.obuchowski@datadoghq.com>
@lmassaoy lmassaoy merged commit 2847dd3 into main Oct 15, 2025
6 checks passed
@lmassaoy lmassaoy deleted the sync-1.38.0 branch October 15, 2025 17:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.