3 ms·
It's performance at 21B parameters is very impressive. I also like using something between 13 and 70B parameters, since it will run on a 32GB MacBook Pro easil
by bearjaws 2y ago
It's performance at 21B parameters is very impressive.
I also like using something between 13 and 70B parameters, since it will run on a 32GB MacBook Pro easily.
- thethirdone 2y agoDo note that it has 236 B parameters which makes the weights ~450 GB.