3 ms·
What’s the point of a state of the art AI chip that can’t run large models? It seems problematic to say the least!
by andy_ppp 3y ago
What’s the point of a state of the art AI chip that can’t run large models? It seems problematic to say the least!
- Jensson 3y agoIt can run small models very fast.
- superjan 3y agoIt is a new design, not a direct competitor for nVidia’s flagship. And there are lots more applications for AI than LLMs.
- nomel 3y agoRealtime, low power, isn't really possible today. Think anything motion or reaction related.
- jacobgorm 3y agoSome of us still work on computer vision. 224MiB is fairly massive for convolutional neural network.