0.0.3

github-actions released this 31 May 15:56

· 116 commits to master since this release

56e9d03

Support Mixtral architecture
Support Gemma3 architecture (text only)
Fixed support for Command-R+
Return probs and top probs from generator
Defrag for generator
Many bugfixes
Many performance improvements
A bunch of new eval and test functionality

Full Changelog: v0.0.2...v0.0.3

Assets 11