4 ms·
> Running deepseek 6B on the Private LLM app on the iPhone 13 basically set my phone on fire Hey, I’m the author of Private LLM. I hope you’re joking about the
by woadwarrior01 7mo ago
> Running deepseek 6B on the Private LLM app on the iPhone 13 basically set my phone on fire
Hey, I’m the author of Private LLM. I hope you’re joking about the phone catching fire. Btw, there’s no DeepSeek 6B model, you’re likely talking about the DeepSeek Distill 7B model.
- AndrewKemendo 7mo agoYes thank you for the correct correction The last model I tried to run was Dolphin 3B but even Zephyr1.6B kills the phone pretty fast even with a full battery Even Dolphin completely killed my phone so yeah I can’t really use the Private LLM app for anything heavier than the default 1.6B
- woadwarrior01 7mo agoYeah, I agree. Really hard to fit anything larger on the 4GB of RAM on the iPhone 13 of which, only about (depending on what iOS version you're on) 2.1-2.5GB is usable by apps.