3 ms·
Yes, you did. Back then I went to their github page and I found no mention of x86. Now I see it is there. Great. I'll give it a try. Also I see something much
by Roark66 3y ago
Yes, you did. Back then I went to their github page and I found no mention of x86. Now I see it is there. Great. I'll give it a try.
Also I see something much better. The same guy behind llama.cpp authors a universal ml library that does cpu quantization. I wasn't aware of that and it is far more impressive than running a couple of chosen models.