You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Documented compression option for data prepper otel-logs-source sink (#10196) (#10203)
* Documented compression option for data prepper otel-logs-source sink
* Made changes as per code review comments
---------
(cherry picked from commit 26bf9dc)
Signed-off-by: Zeeshan Alam <Zeeshan.Alam+fidelity@fmr.com>
Signed-off-by: Zeeshan Alam <zeeshan.alam@fmr.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Zeeshan Alam <Zeeshan.Alam+fidelity@fmr.com>
Copy file name to clipboardExpand all lines: _data-prepper/pipelines/configuration/sources/otel-logs-source.md
+12-12Lines changed: 12 additions & 12 deletions
Original file line number
Diff line number
Diff line change
@@ -20,17 +20,17 @@ You can configure the `otel_logs_source` source with the following options.
20
20
21
21
| Option | Type | Description |
22
22
| :--- | :--- | :--- |
23
-
| port |int| Represents the port that the `otel_logs_source` source is running on. Default value is `21892`. |
24
-
| path |string| Represents the path for sending unframed HTTP requests. You can use this option to support an unframed gRPC request with an HTTP idiomatic path to a configurable path. The path should start with `/`, and its length should be at least 1. The `/opentelemetry.proto.collector.logs.v1.LogsService/Export`endpoint is disabled for both gRPC and HTTP requests if the path is configured. The path can contain a `${pipelineName}` placeholder, which is replaced with the pipeline name. If the value is empty and `unframed_requests` is `true`, then the source provides the path `/opentelemetry.proto.collector.logs.v1.LogsService/Export`. |
25
-
| max_request_length | No | ByteCount | The maximum number of bytes allowed in the payload of a single gRPC or HTTP request. Default value is `10mb`.
26
-
| request_timeout |int| Represents the request timeout duration in milliseconds. Default value is `10000`. |
23
+
| port |Integer| Represents the port that the `otel_logs_source` source is running on. Default value is `21892`. |
24
+
| path |String| Represents the path for sending unframed HTTP requests. You can use this option to support an unframed gRPC request with an HTTP idiomatic path to a configurable path. The path should start with `/`, and its length should be at least 1. The `/opentelemetry.proto.collector.logs.v1.LogsService/Export`endpoInteger is disabled for both gRPC and HTTP requests if the path is configured. The path can contain a `${pipelineName}` placeholder, which is replaced with the pipeline name. If the value is empty and `unframed_requests` is `true`, then the source provides the path `/opentelemetry.proto.collector.logs.v1.LogsService/Export`. |
25
+
| max_request_length |String| The maximum number of bytes allowed in the payload of a single gRPC or HTTP request. Default value is `10mb`.|
26
+
| request_timeout |Integer| Represents the request timeout duration in milliseconds. Default value is `10000`. |
27
27
| health_check_service | Boolean | Enables the gRPC health check service under `grpc.health.v1/Health/Check`. Default value is `false`. |
28
28
| proto_reflection_service | Boolean | Enables a reflection service for Protobuf services (see [ProtoReflectionService](https://grpc.github.io/grpc-java/javadoc/io/grpc/protobuf/services/ProtoReflectionService.html) and [gRPC reflection](https://github.com/grpc/grpc-java/blob/master/documentation/server-reflection-tutorial.md)). Default value is `false`. |
29
29
| unframed_requests | Boolean | Enables requests that are not framed using the gRPC wire protocol. Default value is `false`. |
30
-
| thread_count |int| The number of threads to keep in the `ScheduledThreadPool`. Default value is `500`. |
31
-
| max_connection_count |int| The maximum number of open connections allowed. Default value is `500`. |
32
-
|`output_format`| String |Specifies the output format of the generated events. Valid values are `otel` or `opensearch`. Default is `opensearch`. |
33
-
30
+
| thread_count |Integer| The number of threads to keep in the `ScheduledThreadPool`. Default value is `500`. |
31
+
| max_connection_count |Integer| The maximum number of open connections allowed. Default value is `500`. |
32
+
|compression| String |The compression type applied to the client request payload. Valid values are `none` or `gzip`. Use `gzip` to apply GZip decompression to the incoming request. Default is `none` (no compression). |
33
+
| output_format | String | Specifies the output format of the generated events. Valid values are `otel` or `opensearch`. Default is `opensearch`. |
34
34
35
35
### SSL
36
36
@@ -39,11 +39,11 @@ You can configure SSL in the `otel_logs_source` source with the following option
39
39
| Option | Type | Description |
40
40
| :--- | :--- | :--- |
41
41
| ssl | Boolean | Enables TLS/SSL. Default value is `true`. |
42
-
| sslKeyCertChainFile |string| Represents the SSL certificate chain file path or Amazon Simple Storage Service (Amazon S3) path. For example, see the Amazon S3 path `s3://<bucketName>/<path>`. Required if `ssl` is set to `true`. |
43
-
| sslKeyFile |string| Represents the SSL key file path or Amazon S3 path. For example, see the Amazon S3 path `s3://<bucketName>/<path>`. Required if `ssl` is set to `true`. |
42
+
| sslKeyCertChainFile |String| Represents the SSL certificate chain file path or Amazon Simple Storage Service (Amazon S3) path. For example, see the Amazon S3 path `s3://<bucketName>/<path>`. Required if `ssl` is set to `true`. |
43
+
| sslKeyFile |String| Represents the SSL key file path or Amazon S3 path. For example, see the Amazon S3 path `s3://<bucketName>/<path>`. Required if `ssl` is set to `true`. |
44
44
| useAcmCertForSSL | Boolean | Enables TLS/SSL using a certificate and private key from AWS Certificate Manager (ACM). Default value is `false`. |
45
-
| acmCertificateArn |string| Represents the ACM certificate Amazon Resource Name (ARN). ACM certificates take precedence over Amazon S3 or local file system certificates. Required if `useAcmCertForSSL` is set to `true`. |
46
-
| awsRegion |string| Represents the AWS Region used by ACM or Amazon S3. Required if `useAcmCertForSSL` is set to `true` or `sslKeyCertChainFile` or `sslKeyFile` is the Amazon S3 path. |
45
+
| acmCertificateArn |String| Represents the ACM certificate Amazon Resource Name (ARN). ACM certificates take precedence over Amazon S3 or local file system certificates. Required if `useAcmCertForSSL` is set to `true`. |
46
+
| awsRegion |String| Represents the AWS Region used by ACM or Amazon S3. Required if `useAcmCertForSSL` is set to `true` or `sslKeyCertChainFile` or `sslKeyFile` is the Amazon S3 path. |
0 commit comments