3 ms·
Yeah, you don't necessarily need it but it's optimized for Apple Silicon and in my experience feels like it gives slightly better performance than GGUFs. I real
by simonw 2y ago
Yeah, you don't necessarily need it but it's optimized for Apple Silicon and in my experience feels like it gives slightly better performance than GGUFs. I really need to formally measure that so I'm not just running on vibes!
- indigodaddy 2y agoI for one, am willing to just trust you bro ;)
- turnsout 2y agoYeah I’ll go with Simon’s vibes over most people’s measurements!