4 ms·
They will cost an insane amount as well. Maybe less than subscriptions or tokens. But running massive models on laptops with batteries and poor cooling doesn’t
by Gecko4072 2mo ago
They will cost an insane amount as well. Maybe less than subscriptions or tokens. But running massive models on laptops with batteries and poor cooling doesn’t make much sense.
- LeBit 2mo agoUntil hiding PII from the cloud LLM is a resolved issue, running local LLMs will remain a necessity. There are workplaces that refuse to use LLMs because they fear the devs will expose sensitive data without care.
- ignoramous 2mo ago> will cost an insane amount as well We will get to a point where prosumer laptops that etch SoTA LLMs in removable silicon will be as expensive as cars.
- dannyw 2mo agoIf you're a company with a considerable API bill, buying a few Blackwells and a rack could make a lot of economic sense, while still giving your security team full control of the infrastructure