2 ms·
I would bet actual money that they are not doing an apples-to-apples comparison. I have seen how those high-performance libraries are made and I'm still in awe
by david-gpu 2y ago
I would bet actual money that they are not doing an apples-to-apples comparison.
I have seen how those high-performance libraries are made and I'm still in awe at the quality and quantity of the staffing involved. Those were the smartest and most knowledgeable engineers I met in my career.
- ap4 2y agoIt is apples-to-apples. The code from the article runs a chosen kernel 50 times in a loop. In the case of CuBLAS it runs the function cublasGemmEx() 50 times.
- david-gpu 2y agoDoes your implementation support the complete feature set of cublasGemmEx()? E.g. varying matrix sizes, etc. Does your implementation beat cublas on a wide range of cases, or only cherry-picked examples? Does the code from the article follow the best coding practices for cublas in the first place? Generalizing from a micro benchmark is typically hubris.