3 ms·
So your experience isn’t representative of the work presented by this post? Or does llama.cpp use the same technique for quantization?
by skavi 3y ago
So your experience isn’t representative of the work presented by this post? Or does llama.cpp use the same technique for quantization?
- beacon294 3y agoI don't know, hopefully it will help set general expectations.