3 ms·

I might be being dense, but why not distribute the quantized files?

• turbo_fart 4y ago
  With alpaca you get just the quantized file, for llama you need to do it all yourself. Why? No idea