3 ms·
It took 30 years for computers go from entire rooms to desktops, and another 30 years to go from desktops to our pockets. I don't know if we can extrapolate, b
by jamalaramala 2y ago
It took 30 years for computers go from entire rooms to desktops, and another 30 years to go from desktops to our pockets.
I don't know if we can extrapolate, but I can imagine AI inference on our desktops for $500 in a few years...
- stefs 2y agowell, we can AI inference on our desktops for $500 today, just with smaller models and far slower.
- ryao 2y agoThere is no need to use smaller models. You can run the biggest models such as llama 3.1 405B on a fairly low end desktop today: https://github.com/lyogavin/airllm https://github.com/lyogavin/airllm However, it will be far slower as you said.
- deleted 2y ago[deleted]