3 ms·
There's also a 22b model that I appreciate, since it _almost_ fits into my 12GB 3060. But, alas, I might need to get a new GPU if this trend of fatter smaller m
by rcarmo 2y ago
There's also a 22b model that I appreciate, since it _almost_ fits into my 12GB 3060. But, alas, I might need to get a new GPU if this trend of fatter smaller models continues.
- aargh_aargh 2y agoThat's the older version (4 months old), check the release date.
- rcarmo 2y agoAh. I need to find a tighter quantization then, if it exists at all.