kazaper

3 ms·

1. 1.▲
   by kazaper 12d ago

   This one has mistakes though.. The ANE definitely exists in the m5 and has more tflops than the m4 or m3 version.
2. 2.▲
   by kazaper 12d ago

   It sucks
3. 3.▲
   by kazaper 12d ago

   I've got qwen 3.8 flash next and qwen 3.8 27b working on the ANE - 4 tok/s decode and 40 tok/s for 27b and 80 tok/s with 15-20tok/s decode for flash next.