roberta-large support #7007
Unanswered
alexbenari
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Is it possible to use roberta-large with llama.cpp?
My end goal is to compute a log-likelihood sentence score for sequences using this model (as defined in this paper). So I was planning to use llama.cpp for inference and implement the score computation on top of that (basically port the minicons python implementaiton or find an existing cpp implementaiton which I failed to do so far).
Does anyone have an idea how I can get roberta-large to work on llama.cpp? Any pointers on scoring implementation will also be gratly appreciated,
Beta Was this translation helpful? Give feedback.
All reactions