3 ms·
I'm looking forward to a 4-bit quantized version that I can run on my Intel Thinkpad with 32GB RAM, should be almost usable if its as fast as a 14B size model.
by kristianp 3y ago
I'm looking forward to a 4-bit quantized version that I can run on my Intel Thinkpad with 32GB RAM, should be almost usable if its as fast as a 14B size model.
Whether it's any good is another matter, I guess the leaderboard on HuggingFace will be updated at some point.