You can only run a distilled model. They're quite good but not nearly as good as the full thing. As for as fast as you can read, depends on the distilled size.

You can only run a distilled model. They're quite good but not nearly as good as the full thing. As for as fast as you can read, depends on the distilled size. I have a mac mini 64 GB Ram. The 32 GB models are quite slow. 14B and lower are very very fast.