4 ms·
If you have a modern iPhone you can try running an LLM directly on it today using the MLC iPhone app: https://mlc.ai/mlc-llm/#iphone https://mlc.ai/mlc-llm/#iph
by simonw 3y ago
If you have a modern iPhone you can try running an LLM directly on it today using the MLC iPhone app: https://mlc.ai/mlc-llm/#iphone https://mlc.ai/mlc-llm/#iphone
It can run Vicuna-7B which is a pretty impressive model.
(They have an Android app too but I haven't tried that yet).
- haunter 3y ago>the MLC iPhone app Seems like US only
- brucethemoose2 3y agoMLC is great, but unfortunately is a demo more than anything. Other front ends aren't really integrating MLC yet.