4 ms·
It's too expensive for that unless you had a pretty generous subscription fee. I think local models are probably best suited for gaming where a decent GPU is al
by brian-armstrong 1y ago
It's too expensive for that unless you had a pretty generous subscription fee. I think local models are probably best suited for gaming where a decent GPU is already likely present.
- theptip 1y agoI think there is a niche for both. Local LLMs are orders of magnitude smaller, so you could imagine cloud bursting for the difficult/important work like generating character portraits. That said it’ll be 10-20x cheaper in a year at which point I don’t think you care about price for this workflow in 2D games.