3 ms·you need to benchmark against llama.cpp as well.by ekianjo 1y agoyou need to benchmark against llama.cpp as well.