4 ms·
The great thing about the current-gen LLMs — anybody will be able to run one on the next gen of hardware. We’re within one order of magnitude of the capacity r
by _yid9 4y ago
The great thing about the current-gen LLMs — anybody will be able to run one on the next gen of hardware. We’re within one order of magnitude of the capacity right now on retail hardware.
The moment of transition from “data-centric” (big centralized system/database) to “agent-centric” (locally stored/run systems and identity, sharing arbitrary data/storage) has arrived.
GDPR, LLM “guard rails”, … — only the plebs will be affected by those.
- TigeriusKirk 4y agoI believe you could run GPT-2 at home now. Remember when OpenAI claimed that was too much power to allow open access to?
- pjkundert 4y agoBenevolent overlords patting the filthy masses on the head.
- nateburke 4y ago> The moment of transition from “data-centric” (big centralized system/database) to “agent-centric” (locally stored/run systems and identity, sharing arbitrary data/storage) has arrived. I agree. Use cases such as LLMs-as-backend-of-my-web-stack will move a lot of compute back to the edge of the network, eventually.