4 ms·

Are you using the full BF16 model or a quantized mlx4?

• linolevan 9mo ago
  Not sure what the default is – whatever that was. It's probably the quantized mlx4 if I had to guess.