Skip to content

[FEATURE] Limit usage by tokens #3

@DavideDelbianco

Description

@DavideDelbianco

Problem Statement
Blocking requests by tokens used is not available

Proposed Solution
If it would be possible to track the total token usage reported by the workflow invocation you could track it to use as an alternative "lockout" method

Impact
Most Model providers charge users per 1M token, if you plan to sell to your final customers "bundles" based on tokens and not number of invocations, this would be VERY useful, especially when you want to stop abusive behaviors like sending very long chat messages

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions