-
Notifications
You must be signed in to change notification settings - Fork 384
Open
Labels
enhancementNew feature or requestNew feature or request
Description
First check
- I added a descriptive title to this issue.
- I used the GitHub search to look for a similar issue and didn't find it.
- I searched the Marvin documentation for this feature.
Describe the current behavior
It is cheaper if we batch in regular llm frameworks, just wondering if this is doable in case of marvin.
Describe the proposed behavior
as above.
Example Use
No response
Additional context
No response
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request