17 ms·
Given LLAMA runs enough to be interesting on a Macbook I'm not sure this is going to be a fundamental limitation, and if it's one today it's certainly within th
by Mindwipe 4y ago
Given LLAMA runs enough to be interesting on a Macbook I'm not sure this is going to be a fundamental limitation, and if it's one today it's certainly within the order of magnitude that models will run locally within a few years.
This is why attempting to put guardrails around it simply won't work tbh.
- wilsonnb3 4y agoIt is the training of new models that requires huge compute, not running them
- Mindwipe 4y agoSure, but that isn't like Bitcoin it doesn't have to scale up to every bit of usage. We are already getting interesting scenarios from models that are done and the energy spent. That isn't a fundamental limitation.
- permo-w 4y agothe discussion is about whether it’s possible to ban development or not