3 ms·Llama.cpp and many others support 4 bit weights and lowerby buildbot 3y agoLlama.cpp and many others support 4 bit weights and lower