3 ms·
> I predict non-smartphone AI devices will fail. The AI device of the future is likely an iPhone or android phone with a dedicated GPU chip for AI. I go back a
by rgbrgb 3y ago
> I predict non-smartphone AI devices will fail. The AI device of the future is likely an iPhone or android phone with a dedicated GPU chip for AI.
I go back and forth on this. While I see this being the case for data collection wearables like humane or tab, it makes sense to have a personal AI computer like bedrock [0], tinybox [1], or a mac studio for running background tasks on personal data. If you're running agents that do more than chat, you need something that's going to be able to handle doing inference for extended periods of time without worrying about heat or battery life. You likely also want something capable of doing fine-tune level training on your personal inputs. A lot of the more interesting use-cases are on data you probably don't want to expose to a cloud provider. That said, probably Apple is eventually going to crush here as well, but maybe there's room for a challenger to develop as this niche opens up.
[0]: https://www.bedrock.computer/gal https://www.bedrock.computer/gal
[1]: https://tinygrad.org https://tinygrad.org
- BizarroLand 3y agoGoogle & Coral AI already has a $25 usb powered tensor inferencer that can do 4tops. I don't think it will take much more than that to get the rest of the way.
- datameta 3y agoI think distributed TinyML(aka AIoT) with multiple Oura-like wearables on the body for (near)total health monitoring is al likely contender.