3 ms·
Sorry for the basic question but doe anyone know if this useable on a m1 macbook? or is it really time to upgrade to an m3? Thank you
by ionwake 2y ago
Sorry for the basic question but doe anyone know if this useable on a m1 macbook? or is it really time to upgrade to an m3? Thank you
- wsgeorge 2y agoYou should be able to run smaller models on an M1. I'm testing this in about 10mins
- ionwake 2y agohow did it go wsgeorge? is there like a 10 second pause between each word when running on a Mac? I thought I could only run 8b models on it from what I remember last year and even those were super slow!
- svachalek 2y agoYou can run the smaller distilled models, depending on your RAM. Probably the 14b.