3 ms·
I've got qwen 3.8 flash next and qwen 3.8 27b working on the ANE - 4 tok/s decode and 40 tok/s for 27b and 80 tok/s with 15-20tok/s decode for flash next.
by kazaper 20d ago
I've got qwen 3.8 flash next and qwen 3.8 27b working on the ANE - 4 tok/s decode and 40 tok/s for 27b and 80 tok/s with 15-20tok/s decode for flash next.