3 ms·

128MB? Quantization has come a long way!

• danielhanchen 1y ago
  I think they mis-spoke 128GB* :)
  • regularfry 1y ago
    Wishful thinking there on my part.
    • danielhanchen 1y ago
      Though technically < 1GB is enough - one had offload it to the SSD, albeit with very slow speeds!