2 ms·
Wow, so it's possible. Any idea how are they doing this?
by imshashank 2y ago
Wow, so it's possible. Any idea how are they doing this?
- jaggs 2y agoMaybe a really tiny LLM? Like this? https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5-gguf/blob/main/ggml-model-IQ2_M.gguf https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5-gguf/blo... [Edit: just checked Reddit and it's apparently a 3B model (phi 2)] https://www.reddit.com/r/LocalLLaMA/comments/1bpw9c7/running_llm_on_android_snapdragon_8_gen_3/ https://www.reddit.com/r/LocalLLaMA/comments/1bpw9c7/running...
- imshashank 2y agoInteresting, thanks for sharing.