4 ms·
It like dumping all your cash into mainframes right before the PC revolution.
by retrocog 1y ago
It like dumping all your cash into mainframes right before the PC revolution.
- dcre 1y agoThe PC revolution in this analogy is local models? However good and fast they get locally, the same model will run 10-1000x faster on a dedicated device. I think cloud models will be in demand for a long time even before you factor in efficiencies of scale.
- brainwad 1y agoAlso there will be tons of loads that are natively server side and don't make sense to use a local model for (or where using server side models retains more control).