4 ms·

is graph execution used for training only or inference also?

• LoganDark 3y ago
  Inference. It's a big bottleneck for RWKV.cpp, second only to the matrix multiplies.