3 ms·
Saw this a while ago. I don't know enough about math to know if this works as described...I hope it does! A tiny dedicated chip for AI inference jobs is probabl
by discardedrefuse 3y ago
Saw this a while ago. I don't know enough about math to know if this works as described...I hope it does! A tiny dedicated chip for AI inference jobs is probably the next game changer the industry needs to put AI in everyone's pocket. Too bad OpenAI is going to kill any chance at something like this with regulatory capture.
- mrguyorama 3y agoIf you have an iPhone or a modern Pixel, you already have a dedicated AI accelerator in your pocket.
- discardedrefuse 3y agoActually, I have a Pixel 7 with the Tensor G2. I can't find the tera operations per second on it, but Google has said that its [1] 60% more powerful than their Tensor Coral (4 TOPS at 2W of power). That puts the G2 at about 6.4 TOPS. The Mythic analog chip [2] is pumping 25 TOPS at 3W. For comparison, modern (digital) GPUs are doing 25-100 TOPS at 50W-100W...while costing >$1000. So, its a big jump. [1] https://www.xda-developers.com/google-tensor-g2-changes/ https://www.xda-developers.com/google-tensor-g2-changes/ [2] https://youtu.be/GVsUOuSjvcg?t=1060 https://youtu.be/GVsUOuSjvcg?t=1060