Skip to content

New batch payload limit #1576

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from
Closed

New batch payload limit #1576

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
57 changes: 32 additions & 25 deletions docs/limits.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,6 @@ title: "Limits"
description: "There are some hard and soft limits that you might hit."
---

import RateLimitHitUseBatchTrigger from "/snippets/rate-limit-hit-use-batchtrigger.mdx";

## Concurrency limits

| Pricing tier | Limit |
Expand Down Expand Up @@ -54,7 +52,7 @@ If you're creating schedules for your user you will definitely need to request m
| Limit | Details |
| :--------------------- | :-------------------------------------------- |
| Single trigger payload | Must not exceed 3MB |
| Batch trigger payload | The total of all payloads must not exceed 1MB |
| Batch trigger payload | The total of all payloads must not exceed 5MB |
| Task outputs | Must not exceed 10MB |

Payloads and outputs that exceed 512KB will be offloaded to object storage and a presigned URL will be provided to download the data when calling `runs.retrieve`. You don't need to do anything to handle this in your tasks however, as we will transparently upload/download these during operation.
Expand All @@ -78,38 +76,47 @@ A single batch can have a maximum of 500 items.
We limit the size of logs to prevent oversized data potentially causing issues.

<Expandable title="log limits">
#### Attribute Limits

* Span Attribute Count Limit: 256

* Log Attribute Count Limit: 256

* Span Attribute Value Length Limit: 1028 characters

* Log Attribute Value Length Limit: 1028 characters

#### Event and Link Limits

* Span Event Count Limit: 10

* Link Count Limit: 2

* Attributes per Link Limit: 10

* Attributes per Event Limit: 10

#### Attribute Limits
#### I/O Packet Length Limit

- Span Attribute Count Limit: 256
- Log Attribute Count Limit: 256
- Span Attribute Value Length Limit: 1028 characters
- Log Attribute Value Length Limit: 1028 characters
128 KB (131,072 bytes)

#### Event and Link Limits
#### Attribute Clipping Behavior

- Span Event Count Limit: 10
- Link Count Limit: 2
- Attributes per Link Limit: 10
- Attributes per Event Limit: 10
* Attributes exceeding the value length limit (1028 characters) are discarded.

#### I/O Packet Length Limit
* If the total number of attributes exceeds 256, additional attributes are not included.

128 KB (131,072 bytes)
#### Attribute Value Size Calculation

#### Attribute Clipping Behavior
* Strings: Actual length of the string

- Attributes exceeding the value length limit (1028 characters) are discarded.
- If the total number of attributes exceeds 256, additional attributes are not included.
* Numbers: 8 bytes

#### Attribute Value Size Calculation
* Booleans: 4 bytes

- Strings: Actual length of the string
- Numbers: 8 bytes
- Booleans: 4 bytes
- Arrays: Sum of the sizes of all elements
- Undefined or null: 0 bytes
* Arrays: Sum of the sizes of all elements

* Undefined or null: 0 bytes
</Expandable>

## Alerts
Expand All @@ -134,4 +141,4 @@ See the [machine configurations](/machines#machine-configurations) for more deta
| :----------- | :--------------- |
| Free | 5 team members |
| Hobby | 5 team members |
| Pro | 25+ team members |
| Pro | 25+ team members |
Loading