Skip to content

Feat: Improved fault tolerance for smaller models #6

@ntegrals

Description

@ntegrals

Is your feature request related to a problem? Please describe.
The current way to parse commands heavily relies on consistent output format generated by the LLM. If the LLM deviates from that structure, the application won't be able to reliably build applications any more.

Describe the solution you'd like
There should be a fallback when a command (e.g. dec-write) fails, and a good way to test if smaller models work reliably with the current system prompt.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions