5 ms·
Yeah soon there will be models small enough to run even on phones to reword things slightly differently. If not, an app will do it
by m3kw9 3y ago
Yeah soon there will be models small enough to run even on phones to reword things slightly differently. If not, an app will do it
- speedgoose 3y agoI already have one running on my phone: https://mlc.ai/mlc-llm/ https://mlc.ai/mlc-llm/
- awill88 3y agoyou are very kind thank you
- activiation 3y agoThis crashes on my Android device
- m3kw9 3y agoI know about this app, in fact I’m one of your beta testers, didn’t know it was running local models lol. But this thing almost 2gbs.
- mdrzn 3y agoInstalled on my S21, it just crashes whenever opened.
- MacsHeadroom 3y agoI use Sherpa to run 7B and 13B LLaMA/Alpaca models on my phone: https://github.com/Bip-Rep/sherpa https://github.com/Bip-Rep/sherpa