Skip to content

Commit f5d465b

Browse files
committed
feat(dedicated): iceberg for snowflake:
- Merge fixes - Provide instruction for checking snapshot status - Cleanup
1 parent 6af2b3f commit f5d465b

File tree

3 files changed

+49
-34
lines changed

3 files changed

+49
-34
lines changed

content/influxdb3/cloud-dedicated/process-data/export/iceberg-for-snowflake.md

Lines changed: 0 additions & 19 deletions
This file was deleted.

content/influxdb3/cloud-dedicated/process-data/export/_index.md renamed to content/influxdb3/cloud-dedicated/query-data/use-integrations/_index.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,15 @@
11
---
2-
title: Export data
2+
title: Use integrations to export and query data
33
description: >
44
Use InfluxData export tools to integrate time series data stored in {{% product-name %}} with other tools and systems
55
and avoid complex ETL processes.
66
menu:
77
influxdb3_cloud_dedicated:
8-
parent: Process & visualize data
8+
parent: Query data
9+
name: Use integrations
910
weight: 103
1011
---
11-
Use InfluxData export tools to:
12+
Use {{% product-name %}} integrations:
1213

1314
- Integrate time series data stored in {{% product-name %}} with other tools and systems
1415
- Avoid complex ETL (Extract, Transform, Load) processes

content/shared/influxdb3-query-guides/snapshots/snowflake.md renamed to content/influxdb3/cloud-dedicated/query-data/use-integrations/iceberg-for-snowflake.md

Lines changed: 45 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,17 @@
1+
---
2+
title: Export Iceberg for Snowflake
3+
seotitle: Export time series data to Iceberg format for Snowflake
4+
description: >
5+
Integrate {{< product-name >}} with Snowflake without complex ETL processes.
6+
Export time series data snapshots into Apache Iceberg format and query directly from Snowflake.
7+
menu:
8+
influxdb3_cloud_dedicated:
9+
name: Export Iceberg for Snowflake
10+
parent: Use integrations
11+
weight: 101
12+
influxdb3/cloud-dedicated/tags: [integrations, snowflake, iceberg, export]
13+
---
14+
115
Integrate {{< product-name >}} with Snowflake without complex ETL processes.
216
Export time series data snapshots into Apache Iceberg format and query directly from Snowflake.
317

@@ -40,16 +54,18 @@ Before you begin, ensure you have an [{{< product-name >}} account](/influxdb3/c
4054

4155
The {{% product-name %}} Iceberg integration requires setup by the InfluxData team.
4256
After you have contacted sales and enabled Iceberg integration, you'll specify which
43-
tables you want to make available for exporting.
44-
InfluxData support engineers will help you with the integration steps, which include:
57+
tables you want to make available for export.
58+
InfluxData support engineers will work with you to set up the integration by:
4559

46-
- Setting up a Snowflake external stage using the `CREATE STAGE` Snowflake SQL command and your storage provider details.
47-
This establishes an external storage location (such as AWS S3) to store Iceberg table data and metadata.
48-
- Setting up a catalog integration in Snowflake to manage and load Iceberg tables efficiently.
49-
For more information, refer to the [Snowflake documentation](https://docs.snowflake.com/en/user-guide/tables-iceberg-configure-catalog-integration).
50-
- Creating an export configuration that tells the InfluxDB Iceberg exporter which tables are available for export.
60+
- Configuring a Snowflake external stage using the `CREATE STAGE` SQL command with your storage provider details.
61+
This creates an external storage location (such as AWS S3) for Iceberg table data and metadata.
62+
- Establishing a catalog integration in Snowflake to efficiently manage and load Iceberg tables.
63+
For more information, see the [Snowflake documentation](https://docs.snowflake.com/en/user-guide/tables-iceberg-configure-catalog-integration).
64+
- Creating an exports configuration that specifies which tables are available for export.
5165

66+
<!-- Customer-triggered exports aren't yet supported.
5267
After the setup is complete, you can export data snapshots to Iceberg format and query the Iceberg table from Snowflake.
68+
-->
5369

5470
> [!Important]
5571
> #### Export tables are read-only in Snowflake
@@ -60,6 +76,14 @@ After the setup is complete, you can export data snapshots to Iceberg format and
6076
6177
## Export data to Iceberg format
6278

79+
After the setup is complete, the InfluxData Support team triggers the initial export of your data snapshots.
80+
The exported data is stored in Iceberg format in the external storage location you specified.
81+
82+
_To refresh the exported data with new or changed data, submit a request to the
83+
[InfluxData Support team](https://support.influxdata.com) each time a refresh is needed.
84+
Currently, customer-triggered exports aren't supported._
85+
86+
<!-- Customer-triggered exports aren't yet supported.
6387
Use the `influxctl` CLI or the HTTP API to export snapshots to Iceberg format.
6488
6589
> [!Important]
@@ -82,8 +106,8 @@ influxctl snapshot export --namespace NAMESPACE --table TABLE_NAME
82106
83107
Replace the following:
84108
85-
- {{% code-placeholder-key %}}`NAMESPACE`{{% /code-placeholder-key %}}: The namespace of the data to export. <!-- Namespace might need more explanation -->
86-
- {{% code-placeholder-key %}}`TABLE_NAME`{{% /code-placeholder-key %}}: The table name to export
109+
- {{% code-placeholder-key %}}`NAMESPACE`{{% /code-placeholder-key %}}: The namespace (database) that contains the tables to export
110+
- {{% code-placeholder-key %}}`TABLE_NAME`{{% /code-placeholder-key %}}: The name of the table to export
87111
88112
{{% /tab-content %}}
89113
{{% tab-content %}}
@@ -112,21 +136,27 @@ curl -X POST https://{{% influxdb/host %}}/snapshots/export \
112136
113137
Replace the following:
114138
115-
- {{% code-placeholder-key %}}`NAMESPACE`{{% /code-placeholder-key %}}: The namespace of the data to export. <!--Might need more explanation-->
116-
- {{% code-placeholder-key %}}`TABLE_NAME`{{% /code-placeholder-key %}}: The table name to export
139+
- {{% code-placeholder-key %}}`NAMESPACE`{{% /code-placeholder-key %}}: The namespace (database) that contains the tables to export
140+
- {{% code-placeholder-key %}}`TABLE_NAME`{{% /code-placeholder-key %}}: The name of the table to export
117141
118142
{{% /tab-content %}}
119143
{{< /tabs-wrapper >}}
144+
-- Customer-triggered exports aren't supported -->
120145

121146
## Check snapshot status
122147

148+
To check the status of a snapshot export, contact the [InfluxData Support team](https://support.influxdata.com).
149+
150+
<!-- API isn't yet available to customers.
151+
123152
Use the HTTP API to check the status of an ongoing or completed snapshot export.
124153
125154
{{% api-endpoint method="GET" endpoint="/snapshots/status" %}}
126155
127156
```bash
128157
curl -X GET https://{{% influxdb/host %}}/snapshots/status
129158
```
159+
-- API isn't yet available to customers -->
130160

131161
## Query the Iceberg table from Snowflake
132162

@@ -136,8 +166,11 @@ Use SQL in Snowflake to query the Iceberg table exported from {{< product-name >
136166

137167
When exporting data from InfluxDB to an Iceberg table, keep the following considerations and limitations in mind:
138168

169+
- **Export controls limited to InfluxData**: You can't export or refresh data to Iceberg format independently. The InfluxData Support Team handles set up of the initial export and subsequently handles all data refreshes.
170+
Submit a request to the [InfluxData Support team](https://support.influxdata.com) to:
171+
- Update your Snowflake tables with new or changed data
172+
- Check the status of a snapshot export
139173
- **Exported data is read-only**: Tables created through this integration are _read-only_. You cannot write directly to these tables using Snowflake or any other engine.
140174
- **Data consistency**: Ensure that the exported data in the Iceberg table is consistent with the source data in InfluxDB.
141175
- **Performance**: Query performance may vary based on data size and query complexity.
142176
- **Feature support**: Some advanced features of InfluxDB may not be fully supported in Snowflake through Iceberg integration.
143-

0 commit comments

Comments
 (0)