3 ms·
The diminishing returns from model scale means that if your personal computer improves twofold in the same time a datacenter improves fivefold, you may still ha
by Ukv 3y ago
The diminishing returns from model scale means that if your personal computer improves twofold in the same time a datacenter improves fivefold, you may still have lessened the gap in terms of quality.
That doesn't mean you'll be able to run the best model, but I'm relatively optimistic about the gap not growing out of control.
- PeterisP 3y agoWell, sure, one thing is that the absolute numbers do increase, so for any given notion of "good enough", every device at some point will reach the level where it will be able to run it.