3 ms·

Is the model response quality identical to the memory unconstrained model?

• gitpusher42 2mo ago
  Yeah, it must be exactly the same. The same weights are used, nothing skipped or pruned. But it might have differ to MLX for greedy decode because of small floating-point nums difference