-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Description
Problem Statement
Blocking requests by tokens used is not available
Proposed Solution
If it would be possible to track the total token usage reported by the workflow invocation you could track it to use as an alternative "lockout" method
Impact
Most Model providers charge users per 1M token, if you plan to sell to your final customers "bundles" based on tokens and not number of invocations, this would be VERY useful, especially when you want to stop abusive behaviors like sending very long chat messages
Metadata
Metadata
Assignees
Labels
No labels