4 ms·
Serious question, are there open source designs available for RISC today that do “good enough” matrix multiplication? I have no doubt that Nvidia has extensive
by 0cf8612b2e1e 3y ago
Serious question, are there open source designs available for RISC today that do “good enough” matrix multiplication?
I have no doubt that Nvidia has extensive optimizations to get SOTA performance, but I am curious what is attainable off the shelf. If you could design a 5nm chip, would it be possible to hit 15% of a NVidia chip? Significantly more?
Of course, there is more to a GPU than just the matrix multiplication, but I am wondering how much effort it would take to get something off the ground for the well financed organization. Presumably China is actively finding such efforts.
- buildbot 3y agoProbably. There are several companies going with this approach. The real trick is the software and ecosystem around it. It does not matter if you can outperform an H100 if you spend weeks trying to get software to work or debugging if a NaN is a hardware error or your bad code :)
- htrp 3y agoRain is the one that most people (including Altman) are backing.
- kaycebasques 3y agoThere were a bunch of presentations about matrix multiplication at the RISC-V summit last month. I'm not sure if any of the presented hardware is open source but maybe those videos are a good lead for tracking some down? https://www.youtube.com/playlist?list=PL85jopFZCnbMfMRR25ENcRkhhAUGwP5C5 https://www.youtube.com/playlist?list=PL85jopFZCnbMfMRR25ENc...