3 ms·Ah good point, this is using Q4, benchmarked total throughout serving with Llama.cpp.by pants2 6mo agoAh good point, this is using Q4, benchmarked total throughout serving with Llama.cpp.