3 ms·
Yes - but people don't want to pay $4k for a phone with 128GB of unified memory, do they? And whilst the LLM's running locally are cool, they're still pretty d
by philjohn 2y ago
Yes - but people don't want to pay $4k for a phone with 128GB of unified memory, do they?
And whilst the LLM's running locally are cool, they're still pretty damn slow compared to Chat-GPT, or Meta's LLM.
- theshrike79 2y agoDepending on what you want to do though. If I want some help coding or ideas about playlists, Gemini and ChatGPT are fine. But when I'm writing a novel about an assassin with an AI assistant and the public model keeps admonishing me that killing people is bad and he should seek help for his tendencies, it's a LOT faster to just use an uncensored local LLM. Or when I want to create some people faces for my RPG campaign and the online generator keeps telling me my 200+ word prompt is VERBOTEN. And finally I figure out that "nude lipstick" is somehow bad. Again, it's faster to feed all this to a local model and just get it done overnight than fight against puritanised AIs.
- chuckadams 2y agoTo say nothing of battery life.