2 ms·
In the future AI will be commoditized. You'll be able to buy an inference server for your home in the form factor like a wi-fi router now. They will be cheap an
by otabdeveloper4 1y ago
In the future AI will be commoditized. You'll be able to buy an inference server for your home in the form factor like a wi-fi router now. They will be cheap and there will be a huge selection of different models, both open-source and proprietary. You'll be able to download a model with a click of a button. (Or just torrent them.)
- anticensor 1y agoThat can be done with today's desktops already, if you beef up the specs slightly.
- mlnj 1y agoThe smaller models are becoming even more capable now. Add that with a suite of tools and integrations and you can do most of what you do online within the infra at home.
- otabdeveloper4 1y agoCheap Chinese single-board computers made specifically for inference is the missing puzzle piece. (No, GPU's and especially Nvidia is not that.) Also the current crop of AI agents are just utter crap. But that's a skill issue of the people coding them, expect actual advances here soon.
- anticensor 1y agoAren't DGX Spark or Framework Desktop cheap enough?
- otabdeveloper4 1y agoNot really. Eventually we'll get something with the price and availability of a home appliance. (Wi-fi router tier.)