Skip to content

Cold starts #24

@gperdrizet

Description

@gperdrizet

I think we should be spinning up at leas the default model on startup, rather than waiting for the first message. This will cut down on apparent response time for the first message from the user.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions