3 ms·
Yeah, but not just that. I don't expect my mum to go find some high end consumer GPU and install it on a home server in order to run her own local LLM. I expect
by VBprogrammer 1y ago
Yeah, but not just that. I don't expect my mum to go find some high end consumer GPU and install it on a home server in order to run her own local LLM. I expect that people will be throwing chat interfaces running remixed versions of open weight models out on the internet so fast that it's impossible for anyone to monitise it in a reasonable way.
I also wonder whether, similar to bitcoin mining, these things end up on specialist ASICS and before we know it a medium tier mobile phone is running your own local models.
- fragmede 1y agoA top end iphone is capable of running smaller local LLMs today.
- hbn 1y agoA few days late but the cheapest, base model iPhone, the 16e runs Apple Intelligence too (Unfortunately... only Apple Intelligence right now...)
- fragmede 1y agoI don't have a newer iphone to run it on, so I don’t have a specific one to recommend but searching for local LLM in the App Store gives plenty of options so you’re not limited to Apple Intelligence models.