3 ms·
This is really unlikely, because the operations are pretty basic math and the GPUs do these about as efficiently as possible. Surely those GPUs will be improved
by quonn 3y ago
This is really unlikely, because the operations are pretty basic math and the GPUs do these about as efficiently as possible. Surely those GPUs will be improved further, but a custom ASIC probably won‘t help much with training. And NVIDIA has been producing GPUs that are specifically targeted at deep learning and they control both the software library and the hardware. I don‘t quite see how they couldn‘t optimize whatever they want to optimize.
- xadhominemx 3y agoThe chips won't be that much more efficient on a like for like basis but the models will be much smaller so the chips can be smaller or run much larger batches
- pixl97 3y agoBeing that us meatbags operate on a pretty limited power budget I'm guessing there is still a lot of algorithmic optimization to be done, and those algorithms will need hardware to run on.
- londons_explore 3y agoFor inference, there is the option to produce ASIC's with the weights hard coded into the chip. They'll be super fast and power efficient, with the huge downside they aren't reprogrammable.