3 ms·

I've seen llamafile go about 10x faster on CPU if you try it.

• yjftsjthsd-h 2y ago
  Really! Same model and everything? I guess I need to go benchmark them - 10x would legit obviate GPU for me