3 ms·
Had to try this on my laptop (vs my non-byteshape qwen3-30-a3b) Original: 11tok/s Byteshape: 16tok/s Quite a nice improvement!
by nunodonato 9mo ago
Had to try this on my laptop (vs my non-byteshape qwen3-30-a3b)
Original: 11tok/s
Byteshape: 16tok/s
Quite a nice improvement!