2 ms·Inference. It's a big bottleneck for RWKV.cpp, second only to the matrix multiplies.by LoganDark 3y agoInference. It's a big bottleneck for RWKV.cpp, second only to the matrix multiplies.