2 ms·

I'm so jazzed to comfortably run Llama 3 405b on my Mac with less quantization.

• gigatexal 2y ago
  It only goes to 128 :/