2 ms·
> Not to mention the current token cost. Games is one place where running local LLM's is a no-brainer.
by otabdeveloper4 1y ago
> Not to mention the current token cost.
Games is one place where running local LLM's is a no-brainer.
- KronisLV 1y agoWith the advent of unoptimized UE5 releases becoming the norm and the mentality of shipping badly broken games by default and them only being in a good state years later if at all, I’m not sure running an LLM on device would be a good idea.