3 ms·
Reliably serving planet-scale inference is a whole different ballgame.
by xnx 2y ago
Reliably serving planet-scale inference is a whole different ballgame.
- maxglute 2y agoIt's going to be an increasingly irrelevant game when models make regional scale, i.e. country/sovereign scale inference attainable. Countries that couldn't even role out domestic search pre accessible models that displaces search likely soon can.
- xnx 2y agoFor 2024-level tech I agree. The future is multimodal and a lot of processing power will be needed for that.