3 ms·
> decode (GEMV) is memory bound Decode with batch size 1 is GEMV. Batching makes the decode GEMM too.
by Const-me 4mo ago
> decode (GEMV) is memory bound
Decode with batch size 1 is GEMV. Batching makes the decode GEMM too.
loading thread…
3 ms·