3 ms·
App to Run LLMs on Android
- ValleZ 3y agoOne way to run LLM on android phone is to run ggerganov/llama.cpp in console like termux and it works quite well but is not super convenient. I was working on the app to make running on-device LLMs more user friendly, please try it out!
- Zambyte 3y agoCool project! Where is the source code for this?
- ValleZ 3y agoIt's closed source for now, but it's based on llama.cpp and I'm planning to improve the included android example in the llama.cpp