3 ms·
Interesting. You're using the FP8 version i'm guessing? How many tokens/s are you using and which software? MLX?
by Tepix 2y ago
Interesting. You're using the FP8 version i'm guessing?
How many tokens/s are you using and which software? MLX?
loading thread…