How to Integrate Accelerator to Android Sample Code

[affereaflaw]

I am able to run sample code on android studio and run some models with it. Thank you for the great works!

I am wondering about if I want to update the llama cpp from sample code from the latest release of the repo, how can I do that? and can I also integrate accelerator like Vulkan / OpenCL inside the app via android studio? Any guidance really appreciated :)

Would be nice if there is a separate documentation for it

[ejrydhfs]

If you are building an app around llama.cpp you will need to have the app update llama.cpp. Not sure about acceleration do you have any issues doing it?

[affereaflaw]

Thanks for the reply.

I was able to cross compile OpenCL and run it on adb shell but have no idea to integrate it with the llama-android sample code

https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/OPENCL.md#android