Skip to content

Keep prompt in input buffer #25

@gperdrizet

Description

@gperdrizet

As the conversation history grows, the original prompt gets pushed out of the LLM's input buffer. I think we should probably be keeping it to anchor the slice of messages we do send for inference.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions