Skip to content

Conversation

k3rnL
Copy link

@k3rnL k3rnL commented Nov 21, 2024

Description

This PR introduces a new connector for InfluxDB, enabling Trino to query time-series data stored in InfluxDB. InfluxDB is a widely used time-series database but diverges from many traditional database standards, requiring a tailored approach to integration.

Additional context and related issues

I must note that most of the work was made in the past, but the PR was never finalized #15549
I have mostly only rebased the code, fixed tests and adapt the code to the new requirements.
My addition is the support for schema creation and schema/table destruction.

Release notes

( ) Release notes are required, with the following suggested text:

## Section
* Add InfluxDB connector. ({issue}`issuenumber`)

@github-actions github-actions bot added the docs label Nov 21, 2024
@k3rnL k3rnL force-pushed the k3rnl/influxdb-connector branch 9 times, most recently from c26a3f8 to caed040 Compare November 22, 2024 22:30
@k3rnL
Copy link
Author

k3rnL commented Nov 23, 2024

I'm not sure if the CI fails because of the PR's code or if the tests are flaky ?

@ebyhr
Copy link
Member

ebyhr commented Nov 24, 2024

ci / pt (default, suite-all-connectors-smoke, ) looks related to this change. Other failures are unrelated.

@k3rnL k3rnL force-pushed the k3rnl/influxdb-connector branch from caed040 to 480d66d Compare November 24, 2024 21:49
Copy link

This pull request has gone a while without any activity. Tagging for triage help: @mosabua

@github-actions github-actions bot added the stale label Dec 16, 2024
Copy link

github-actions bot commented Jan 6, 2025

Closing this pull request, as it has been stale for six weeks. Feel free to re-open at any time.

@github-actions github-actions bot closed this Jan 6, 2025
@diegocareaga
Copy link

Hey @k3rnL Do you know what happened at the end? I will be happy to collaborate with you. I see your connector really interesting. 👍

@k3rnL
Copy link
Author

k3rnL commented Feb 17, 2025

A lack of time mostly ! The connector is working well, the problem is to be compliant with the autonomous tests..
I was close to pass all the tests though, I think it does not need a lot of work to pass the tests.

@k3rnL k3rnL reopened this Feb 17, 2025
@k3rnL k3rnL force-pushed the k3rnl/influxdb-connector branch from 480d66d to 42a0cb4 Compare February 17, 2025 20:20
@cla-bot cla-bot bot added the cla-signed label Feb 17, 2025
@diegocareaga
Copy link

@k3rnL Could you please update the pom.xml in (plugin/trino-influxdb) with this version of trino-root snapshot? and try again? 471

471-SNAPSHOT instead of 466-SNAPSHOT and then we will see what happen

@ebyhr ebyhr mentioned this pull request Feb 18, 2025
@ebyhr ebyhr force-pushed the k3rnl/influxdb-connector branch from 42a0cb4 to b19ea18 Compare February 18, 2025 01:12
@diegocareaga
Copy link

Hi @k3rnL
I noticed two small things we can fix:

  1. Your pom.xml needs a version update - just change 466-SNAPSHOT to match current version (471-SNAPSHOT). @ebyhr helped us with that but I don't know what happened - maybe a problem with cache here? becase the outdated file is only here -> /home/runner/work/trino/trino/plugin/trino-influxdb/pom.xml

  2. There are some test failures in trino-loki module (not in your influxdb connector). Maybe we could update to the latest version and rebuild?

Really excited to try your InfluxDB connector! I'm eager to collaborate once I have access. Let me know if you need help with these fixes 😊

@ebyhr ebyhr force-pushed the k3rnl/influxdb-connector branch from b19ea18 to e30e1f4 Compare February 18, 2025 10:12
@k3rnL
Copy link
Author

k3rnL commented Feb 18, 2025

Seems @ebyhr just outperformed us 😁 Thank ! But I see that the merging is blocked because of a merge commit, but it seems this commit comes from the main branch itself. I may be mistaken, but I carefully rebased the code..

@diegocareaga
Copy link

@k3rnL congrats you already passed all the tests. Do you know what is the next step? if not I will ask in the slack channel

@k3rnL
Copy link
Author

k3rnL commented Feb 18, 2025

Perfect ! That was faster than I thought :)
Yes you may ask, thanks for your help :)

@dlandz
Copy link

dlandz commented Aug 4, 2025

@k3rnL are you able to get this one through?

@k3rnL k3rnL reopened this Aug 5, 2025
@k3rnL k3rnL force-pushed the k3rnl/influxdb-connector branch from 462476d to ce212fb Compare August 5, 2025 12:13
@lc-spxl
Copy link

lc-spxl commented Aug 5, 2025

Most errors in CI are related to this

Non-resolvable parent POM for io.trino:trino-influxdb:471-SNAPSHOT: The following artifacts could not be resolved: io.trino:trino-root:pom:471-SNAPSHOT (absent): Could not find artifact io.trino:trino-root:pom:471-SNAPSHOT and 'parent.relativePath'

@k3rnL k3rnL force-pushed the k3rnl/influxdb-connector branch from ce212fb to d08634e Compare August 5, 2025 13:47
@k3rnL
Copy link
Author

k3rnL commented Aug 5, 2025

Yup, because I rebased with master, I've synced the version of trino parent in the pom of the connector and also addressed the comments of ebyhr.

There is some changes that I couldn't test on my computer, finger crossed that all the unit tests works 🤞

@github-actions github-actions bot removed the stale label Aug 5, 2025
@k3rnL k3rnL force-pushed the k3rnl/influxdb-connector branch 3 times, most recently from a105a2a to 5b531d8 Compare August 5, 2025 22:58
@k3rnL
Copy link
Author

k3rnL commented Aug 5, 2025

That looks better :)

@dlandz
Copy link

dlandz commented Aug 6, 2025

@ebyhr Is this looking better now?

# InfluxDB connector

The InfluxDB Connector allows access to [InfluxDB](https://www.influxdata.com/) data from Trino.
This document describes how to setup the InfluxDB Connector to run SQL queries against InfluxDB.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wrap at 80 characters. Same for other places.

The connector maps InfluxDB types to the corresponding Trino types
according to the following table:

| InfluxDB type | Trino type | Notes |
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please use {list-table} instead.

return createInfluxQueryRunner(server, REQUIRED_TPCH_TABLES);
}

@SuppressWarnings("DuplicateBranchesInSwitch")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove redundant suppression.

@k3rnL k3rnL force-pushed the k3rnl/influxdb-connector branch from 5b531d8 to b0e8181 Compare August 12, 2025 22:54
Copy link
Author

@k3rnL k3rnL left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I changed the implementation to use the non-deprecated method and solved the reminders.

@k3rnL k3rnL force-pushed the k3rnl/influxdb-connector branch 3 times, most recently from ef05025 to 8f110cf Compare August 13, 2025 00:03
@k3rnL k3rnL force-pushed the k3rnl/influxdb-connector branch from 8f110cf to 8e6dfdc Compare August 13, 2025 00:12
Copy link
Author

@k3rnL k3rnL left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've made the corrections following your comments

Copy link

github-actions bot commented Sep 3, 2025

This pull request has gone a while without any activity. Ask for help on #core-dev on Trino slack.

@github-actions github-actions bot added the stale label Sep 3, 2025
@k3rnL
Copy link
Author

k3rnL commented Sep 4, 2025

@ebyhr Is there something more I can do ?

@github-actions github-actions bot removed the stale label Sep 5, 2025
Copy link

This pull request has gone a while without any activity. Ask for help on #core-dev on Trino slack.

@github-actions github-actions bot added the stale label Sep 26, 2025
Copy link

Closing this pull request, as it has been stale for six weeks. Feel free to re-open at any time.

@github-actions github-actions bot closed this Oct 17, 2025
@k3rnL k3rnL reopened this Oct 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

6 participants