3 ms·
Where is that improvement coming from? Hardware is already here to compute gemm as fast as possible.
by pdhborges 1y ago
Where is that improvement coming from? Hardware is already here to compute gemm as fast as possible.
- leakyfilter 1y agoRaw gemm computation was never the real bottleneck, especially on the newer GPUs. Feeding the matmuls i.e memory bandwidth is where it’s at, especially in the newer GPUs.