[REQ] Is it possible to use optimized llama.cpp from amperecomputing? #327
Description
What kind of request is this?
Other
What is your request or suggestion?
I have an Oracle free tier instance that I would like to use this with. Can build an image that uses ampere optimized models or libraries made by amperecomputingai? At least I would need their optimized llama.cpp. I am VERY new to AI and llm. I do not know what constitutes a model and where the library that uses it begins.
Are you willing to submit PRs to contribute to this feature request?
- Yes, I am willing to implement it.