Skip to content

Commit 91482e6

Browse files
InfluxDB OSS v1.11.7 (#5648)
* InfluxDB OSS v1.11.7 * Apply suggestions from code review * updated specific references to influxdb 1.8 to 1.11 * updated 1.11.7 release notes * fix indentation on 1.11.7 release notes * add language about cloning a new instance with 1.11 * Apply suggestions from code review Co-authored-by: Jason Stirnaman <jstirnaman@influxdata.com> * Apply suggestions from code review * corrected v1 linux binary package name * corrected v1 linux binary package name * bump 1.11.7 flux version to 1.194.5 * added warning about no 32-bit builds (#5661) * updated influxdb v1 latest patch on data/products --------- Co-authored-by: Jason Stirnaman <jstirnaman@influxdata.com>
1 parent df12257 commit 91482e6

File tree

26 files changed

+808
-123
lines changed

26 files changed

+808
-123
lines changed

content/enterprise_influxdb/v1/administration/configure/config-data-nodes.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1650,21 +1650,25 @@ Number of queries allowed to execute concurrently.
16501650
Default is `0`.
16511651

16521652
#### query-initial-memory-bytes
1653+
16531654
Initial bytes of memory allocated for a query.
16541655
`0` means unlimited.
16551656
Default is `0`.
16561657

16571658
#### query-max-memory-bytes
1659+
16581660
Maximum total bytes of memory allowed for an individual query.
16591661
`0` means unlimited.
16601662
Default is `0`.
16611663

16621664
#### total-max-memory-bytes
1665+
16631666
Maximum total bytes of memory allowed for all running Flux queries.
16641667
`0` means unlimited.
16651668
Default is `0`.
16661669

16671670
#### query-queue-size
1671+
16681672
Maximum number of queries allowed in execution queue.
16691673
When queue limit is reached, new queries are rejected.
16701674
`0` means unlimited.

content/enterprise_influxdb/v1/flux/optimize-queries.md

Lines changed: 16 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,9 +22,14 @@ Optimize your Flux queries to reduce their memory and compute (CPU) requirements
2222
- [Measure query performance with Flux profilers](#measure-query-performance-with-flux-profilers)
2323

2424
## Start queries with pushdowns
25-
**Pushdowns** are functions or function combinations that push data operations to the underlying data source rather than operating on data in memory. Start queries with pushdowns to improve query performance. Once a non-pushdown function runs, Flux pulls data into memory and runs all subsequent operations there.
25+
26+
**Pushdowns** are functions or function combinations that push data operations
27+
to the underlying data source rather than operating on data in memory.
28+
Start queries with pushdowns to improve query performance. Once a non-pushdown
29+
function runs, Flux pulls data into memory and runs all subsequent operations there.
2630

2731
#### Pushdown functions and function combinations
32+
2833
The following pushdowns are supported in InfluxDB Enterprise 1.10+.
2934

3035
| Functions | Supported |
@@ -63,6 +68,7 @@ Once a non-pushdown function runs, Flux pulls data into memory and runs all
6368
subsequent operations there.
6469

6570
##### Pushdown functions in use
71+
6672
```js
6773
from(bucket: "db/rp")
6874
|> range(start: -1h) //
@@ -75,6 +81,7 @@ from(bucket: "db/rp")
7581
```
7682

7783
### Avoid processing filters inline
84+
7885
Avoid using mathematic operations or string manipulation inline to define data filters.
7986
Processing filter values inline prevents `filter()` from pushing its operation down
8087
to the underlying data source, so data returned by the
@@ -104,12 +111,14 @@ from(bucket: "db/rp")
104111
```
105112

106113
## Avoid short window durations
114+
107115
Windowing (grouping data based on time intervals) is commonly used to aggregate and downsample data.
108116
Increase performance by avoiding short window durations.
109117
More windows require more compute power to evaluate which window each row should be assigned to.
110118
Reasonable window durations depend on the total time range queried.
111119

112120
## Use "heavy" functions sparingly
121+
113122
The following functions use more memory or CPU than others.
114123
Consider their necessity in your data processing before using them:
115124

@@ -120,6 +129,7 @@ Consider their necessity in your data processing before using them:
120129
- [pivot()](/influxdb/v2/reference/flux/stdlib/built-in/transformations/pivot/)
121130

122131
## Use set() instead of map() when possible
132+
123133
[`set()`](/influxdb/v2/reference/flux/stdlib/built-in/transformations/set/),
124134
[`experimental.set()`](/influxdb/v2/reference/flux/stdlib/experimental/set/),
125135
and [`map`](/influxdb/v2/reference/flux/stdlib/built-in/transformations/map/)
@@ -132,6 +142,7 @@ Use the following guidelines to determine which to use:
132142
- If dynamically setting a column value using **existing row data**, use `map()`.
133143

134144
#### Set a column value to a static value
145+
135146
The following queries are functionally the same, but using `set()` is more performant than using `map()`.
136147

137148
```js
@@ -144,12 +155,14 @@ data
144155
```
145156

146157
#### Dynamically set a column value using existing row data
158+
147159
```js
148160
data
149161
|> map(fn: (r) => ({ r with foo: r.bar }))
150162
```
151163

152164
## Balance time range and data precision
165+
153166
To ensure queries are performant, balance the time range and the precision of your data.
154167
For example, if you query data stored every second and request six months worth of data,
155168
results would include ≈15.5 million points per series.
@@ -160,7 +173,8 @@ Use [pushdowns](#pushdown-functions-and-function-combinations) to optimize how
160173
many points are stored in memory.
161174

162175
## Measure query performance with Flux profilers
163-
Use the [Flux Profiler package](/influxdb/v2/reference/flux/stdlib/profiler/)
176+
177+
Use the [Flux Profiler package](/flux/v0/stdlib/profiler/)
164178
to measure query performance and append performance metrics to your query output.
165179
The following Flux profilers are available:
166180

content/enterprise_influxdb/v1/tools/api.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -249,7 +249,7 @@ curl --request POST "http://localhost:8086/api/v2/delete?bucket=exampleDB/autoge
249249
}'
250250
```
251251
252-
If you use the `predicate` option in your request, review [delete predicate syntax](/influxdb/latest/reference/syntax/delete-predicate/) and note its [limitations](/influxdb/latest/reference/syntax/delete-predicate/#limitations).
252+
If you use the `predicate` option in your request, review [delete predicate syntax](/influxdb/v2/reference/syntax/delete-predicate/) and note its [limitations](/influxdb/v2/reference/syntax/delete-predicate/#limitations).
253253
254254
## InfluxDB 1.x HTTP endpoints
255255
The following InfluxDB 1.x API endpoints are available:

content/enterprise_influxdb/v1/tools/flux-vscode.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -18,15 +18,15 @@ provides Flux syntax highlighting, autocompletion, and a direct InfluxDB server
1818
integration that lets you run Flux scripts natively and show results in VS Code.
1919

2020
{{% note %}}
21-
#### Enable Flux in InfluxDB 1.8
22-
To use the Flux VS Code extension with InfluxDB 1.8, ensure Flux is enabled in
21+
#### Enable Flux in InfluxDB 1.11
22+
To use the Flux VS Code extension with InfluxDB 1.11, ensure Flux is enabled in
2323
your InfluxDB configuration file.
2424
For more information, see [Enable Flux](/enterprise_influxdb/v1/flux/installation/).
2525
{{% /note %}}
2626

2727
##### On this page
2828
- [Install the Flux VS Code extension](#install-the-flux-vs-code-extension)
29-
- [Connect to InfluxDB 1.8](#connect-to-influxdb-18)
29+
- [Connect to InfluxDB 1.11](#connect-to-influxdb-111)
3030
- [Query InfluxDB from VS Code](#query-influxdb-from-vs-code)
3131
- [Explore your schema](#explore-your-schema)
3232
- [Debug Flux queries](#debug-flux-queries)
@@ -38,7 +38,7 @@ The Flux VS Code extension is available in the **Visual Studio Marketplace**.
3838
For information about installing extensions from the Visual Studio marketplace,
3939
see the [Extension Marketplace documentation](https://code.visualstudio.com/docs/editor/extension-gallery).
4040

41-
## Connect to InfluxDB 1.8
41+
## Connect to InfluxDB 1.11
4242
To create an InfluxDB connection in VS Code:
4343

4444
1. Open the **VS Code Command Pallet** ({{< keybind mac="⇧⌘P" other="Ctrl+Shift+P" >}}).

content/enterprise_influxdb/v1/tools/influx_inspect.md

Lines changed: 102 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -29,18 +29,21 @@ influx_inspect [ [ command ] [ options ] ]
2929

3030
The `influx_inspect` commands are summarized here, with links to detailed information on each of the commands.
3131

32-
* [`buildtsi`](#buildtsi): Converts in-memory (TSM-based) shards to TSI.
33-
* [`deletetsm`](#deletetsm): Bulk deletes a measurement from a raw TSM file.
34-
* [`dumptsi`](#dumptsi): Dumps low-level details about TSI files.
35-
* [`dumptsm`](#dumptsm): Dumps low-level details about TSM files.
36-
* [`dumptsmwal`](#dumptsmwal): Dump all data from a WAL file.
37-
* [`export`](#export): Exports raw data from a shard in InfluxDB line protocol format.
38-
* [`report`](#report): Displays a shard level report.
39-
* [`report-disk`](#report-disk): Reports disk usage by shard and measurement.
40-
* [`reporttsi`](#reporttsi): Reports on cardinality for measurements and shards.
41-
* [`verify`](#verify): Verifies the integrity of TSM files.
42-
* [`verify-seriesfile`](#verify-seriesfile): Verifies the integrity of series files.
43-
* [`verify-tombstone`](#verify-tombstone): Verifies the integrity of tombstones.
32+
- [`buildtsi`](#buildtsi): Converts in-memory (TSM-based) shards to TSI.
33+
- [`check-schema`](#check-schema): Checks for type conflicts between shards.
34+
- [`deletetsm`](#deletetsm): Bulk deletes a measurement from a raw TSM file.
35+
- [`dumptsi`](#dumptsi): Dumps low-level details about TSI files.
36+
- [`dumptsm`](#dumptsm): Dumps low-level details about TSM files.
37+
- [`dumptsmwal`](#dumptsmwal): Dump all data from a WAL file.
38+
- [`export`](#export): Exports raw data from a shard in InfluxDB line protocol format.
39+
- [`merge-schema`](#merge-schema): Merges a set of schema files from the `check-schema` command.
40+
- [`report`](#report): Displays a shard level report.
41+
- [`report-db`](#report-db): Estimates InfluxDB Cloud (TSM) cardinality for a database.
42+
- [`report-disk`](#report-disk): Reports disk usage by shard and measurement.
43+
- [`reporttsi`](#reporttsi): Reports on cardinality for measurements and shards.
44+
- [`verify`](#verify): Verifies the integrity of TSM files.
45+
- [`verify-seriesfile`](#verify-seriesfile): Verifies the integrity of series files.
46+
- [`verify-tombstone`](#verify-tombstone): Verifies the integrity of tombstones.
4447

4548
### `buildtsi`
4649

@@ -139,6 +142,31 @@ $ influx_inspect buildtsi -database mydb -datadir ~/.influxdb/data -waldir ~/.in
139142
$ influx_inspect buildtsi -database stress -shard 1 -datadir ~/.influxdb/data -waldir ~/.influxdb/wal
140143
```
141144

145+
### `check-schema`
146+
147+
Check for type conflicts between shards.
148+
149+
#### Syntax
150+
151+
```
152+
influx_inspect check-schema [ options ]
153+
```
154+
155+
#### Options
156+
157+
##### [ `-conflicts-file <string>` ]
158+
159+
Filename conflicts data should be written to. Default is `conflicts.json`.
160+
161+
##### [ `-path <string>` ]
162+
163+
Directory path where `fields.idx` files are located. Default is the current
164+
working directory `.`.
165+
166+
##### [ `-schema-file <string>` ]
167+
168+
Filename schema data should be written to. Default is `schema.json`.
169+
142170
### `deletetsm`
143171

144172
Use `deletetsm -measurement` to delete a measurement in a raw TSM file (from specified shards).
@@ -426,6 +454,26 @@ randset value=97.9296104805 1439856000000000000
426454
randset value=25.3849066842 1439856100000000000
427455
```
428456

457+
### `merge-schema`
458+
459+
Merge a set of schema files from the [`check-schema` command](#check-schema).
460+
461+
#### Syntax
462+
463+
```
464+
influx_inspect merge-schema [ options ]
465+
```
466+
467+
#### Options
468+
469+
##### [ `-conflicts-file <string>` ]
470+
471+
Filename conflicts data should be written to. Default is `conflicts.json`.
472+
473+
##### [ `-schema-file <string>` ]
474+
475+
Filename for the output file. Default is `schema.json`.
476+
429477
### `report`
430478

431479
Displays series metadata for all shards.
@@ -461,6 +509,48 @@ The flag to report exact cardinality counts instead of estimates.
461509
Default value is `false`.
462510
Note: This can use a lot of memory.
463511

512+
### `report-db`
513+
514+
Use the `report-db` command to estimate the series cardinality of data in a
515+
database when migrated to InfluxDB Cloud (TSM). InfluxDB Cloud (TSM) includes
516+
field keys in the series key so unique field keys affect the total cardinality.
517+
The total series cardinality of data in a InfluxDB 1.x database may differ from
518+
from the series cardinality of that same data when migrated to InfluxDB Cloud (TSM).
519+
520+
#### Syntax
521+
522+
```
523+
influx_inspect report-db [ options ]
524+
```
525+
526+
#### Options
527+
528+
##### [ `-c <int>` ]
529+
530+
Set worker concurrency. Default is `1`.
531+
532+
##### `-db-path <string>`
533+
534+
{{< req >}}: The path to the database.
535+
536+
##### [ `-detailed` ]
537+
538+
Include counts for fields, tags in the command output.
539+
540+
##### [ `-exact` ]
541+
542+
Report exact cardinality counts instead of estimates.
543+
This method of calculation can use a lot of memory.
544+
545+
##### [ `-rollup <string>` ]
546+
547+
Specify the cardinality "rollup" level--the granularity of the cardinality report:
548+
549+
- `t`: total
550+
- `d`: database
551+
- `r`: retention policy
552+
- `m`: measurement <em class="op65">(Default)</em>
553+
464554
### `report-disk`
465555

466556
Use the `report-disk` command to review TSM file disk usage per shard and measurement in a specified directory. Useful for capacity planning and identifying which measurement or shard is using the most disk space. The default directory path `~/.influxdb/data/`.

0 commit comments

Comments
 (0)