Add Shrek (entropix) Sampler #9831
underwaterbepis
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
https://github.com/xjdr-alt/entropix
Early testing on Twitter has shown it makes Llama 3.2 1B much better at reasoning as it gives the model “longer to think” during tokens it is uncertain about
Repo and method still in development, see Twitter user xjdr (“AI Shrek”)
Beta Was this translation helpful? Give feedback.
All reactions