3 ms·
I’m exactly there with you with my 13 mini and I did realize that it’s not gonna last as we really get into the era of local LLMs Running deepseek 6B on the Pr
by AndrewKemendo 8mo ago
I’m exactly there with you with my 13 mini and I did realize that it’s not gonna last as we really get into the era of local LLMs
Running deepseek 6B on the Private LLM app on the iPhone 13 basically set my phone on fire
- woadwarrior01 8mo ago> Running deepseek 6B on the Private LLM app on the iPhone 13 basically set my phone on fire Hey, I’m the author of Private LLM. I hope you’re joking about the phone catching fire. Btw, there’s no DeepSeek 6B model, you’re likely talking about the DeepSeek Distill 7B model.
- AndrewKemendo 8mo agoYes thank you for the correct correction The last model I tried to run was Dolphin 3B but even Zephyr1.6B kills the phone pretty fast even with a full battery Even Dolphin completely killed my phone so yeah I can’t really use the Private LLM app for anything heavier than the default 1.6B
- woadwarrior01 8mo agoYeah, I agree. Really hard to fit anything larger on the 4GB of RAM on the iPhone 13 of which, only about (depending on what iOS version you're on) 2.1-2.5GB is usable by apps.