3 ms·
The first step is for it to be viable for smaller models on desktops. The rest will follow, as hardware catches up. Hybrid analog-hybrid NN hardware is on the h
by BulgarianIdiot 4y ago
The first step is for it to be viable for smaller models on desktops. The rest will follow, as hardware catches up. Hybrid analog-hybrid NN hardware is on the horizon, maybe in 3-4 years. This would allow GPT-4 level performance on an iPhone with plausible battery life.
The current hardware of course can't pull anything like this yet. But iPhone supports on-device facial recognition, object recognition, dictation and translation, so small steps...
- boppo1 4y agoWho is making said hardware?
- BulgarianIdiot 4y agoThere are few efforts under way. https://research.ibm.com/blog/why-we-need-analog-AI-hardware https://research.ibm.com/blog/why-we-need-analog-AI-hardware https://news.mit.edu/2022/analog-deep-learning-ai-computing-0728 https://news.mit.edu/2022/analog-deep-learning-ai-computing-...