2 ms·

This model is small enough that it might be sensible to try the same prompts against all of the quant sizes to try and spot any differences.

• simonw 6mo ago
  This inspired me to give that a go: https://simonw.github.io/granite-4.1-3b-gguf-pelicans/ https://simonw.github.io/granite-4.1-3b-gguf-pelicans/
  • archerx 6mo ago
    That was interesting almost like a weird little modern art gallery. I’m surprised that the BF16 one looks so bad…