4 ms·

also no updates since then. does any library follow this reference implementation? llama.cpp surely is more optimized?

• JJJollyjim 4y ago
  llama.cpp runs on the CPU, not the ANE or GPU.