2 ms·
What is your config for getting 80tps decode?
What is your config for getting 80tps decode?
Qwen 3.8 27b Q4_K_M w/ matching dflash drafter, 256k context, llama.cpp+dflash2, draft-n-max=5
Also using with Charmbracelet Crush with Froggerinc fixed chat templates.