4 ms·

I've also been experimenting with the C# implementation https://github.com/trrahul/llama2.cs https://github.com/trrahul/llama2.cs

• pjmlp 3y ago
  Why Parallel.For() instead of SIMD types? I would expect a much better performance.