Of course the other thing that's fun about local AI is that it's free if you already bought an expensive laptop. With the default model, I get ~32 tokens / seco

Of course the other thing that's fun about local AI is that it's free if you already bought an expensive laptop. With the default model, I get ~32 tokens / second on my 2021 m1 ultra MacBook pro with 64GB RAM.