Skip to content

0.4.0

Compare
Choose a tag to compare
@intitni intitni released this 24 Jun 09:14
· 32 commits to main since this release
  • Fill-in-the-middle strategy now supports custom prompt template so you can use it with other models.
  • Support models with an FIM API, for example, Mistral AI FIM endpoint.
  • Support setting suggestion token limit.
  • OpenAI (compatible) APIs will now use stream response. So it will response more promptly when you give it a line limit.