3 ms·

I'm curious why not. I am running a few different models on my mac studio. I'm using llama.cpp, and it performs amazingly fast for the $7k I spent.

• behnamoh 2y ago
  I said in parallel.
  • saagarjha 2y ago
    Surely you can run smaller models together