4 ms·
if o1's can be run from a rasp pi, do you see farms of ARMs in the future?
by BorisMelnik 2y ago
if o1's can be run from a rasp pi, do you see farms of ARMs in the future?
- hakfoo 2y agoAre farms the future? I could see an "AI appliance" like the old Google Search Appliance: A single rack unit with a single $1000 GPU would probably be enough to run a pretty-robust DeepSeek style product, sold as "100% self-contained and on-prem, so you can trust it with propriatery data".