4 ms·
What like 50 token responses? Buddy I'm cranking out 4k. Also LOL at the GPU thing. Its insane how well Apple marketing worked.
by resource_waste 2y ago
What like 50 token responses?
Buddy I'm cranking out 4k.
Also LOL at the GPU thing. Its insane how well Apple marketing worked.
- simonw 2y agoI didn't say an iPhone was as good as a desktop with a dedicated graphics card. I said that an iPhone has a GPU and is capable of running a small but capable LLM. Most people don't know that's possible yet. Why do keep indicating that iPhones don't have a GPU?