3 ms·
And yet enterprises will be the first to move to on-prem LLMs as soon as they become feasible. The next generation of TPU chips already promises 5x efficiency a
by thaanpaa 1mo ago
And yet enterprises will be the first to move to on-prem LLMs as soon as they become feasible. The next generation of TPU chips already promises 5x efficiency and enough RAM to run a 1TB+ model, and Kimi K3 is about as good as Fable for a lot of tasks, so we'll be there much sooner than anyone anticipated.
- techpression 1mo agoOne can only hope, it would be great for everyone, myself included (the company I work for rather)