3 ms·
How hard is it to get the Alpaca tuning on the larger LLaMA models? It's not clear to me where this 4 GB model comes from, but it's much smaller than the LLaMA
by tshaddox 4y ago
How hard is it to get the Alpaca tuning on the larger LLaMA models? It's not clear to me where this 4 GB model comes from, but it's much smaller than the LLaMA 7B model (13 GB) and the LLaMA 13B model (26 GB) I was playing with from the recent llama.cpp HN post.
- chipsa 4y agoThe 4GB model is 7B, AFAIK. It’s just quantized down to 4 bits instead of 16.
- alwayslikethis 4y agoIt's quantized version of the 7B. 13GB in 16 bit, ~4G in 4 bit.