3 ms·
I was thinking about the desktop variants. Apple Silicon is amazing. But if you’re doing heavy GPU it’s not very exciting.
by forrestthewoods 3y ago
I was thinking about the desktop variants.
Apple Silicon is amazing. But if you’re doing heavy GPU it’s not very exciting.
- stevenhuang 3y agoIt's very exciting in the local LLMs space, where the unified memory allows fast inference of large models.
- dagaci 3y agoI read that the bandwidth is 50% lower on the M3 combined with a lower CPU core coun. This reduction will impact inferrence performance. It maybe better to stick with M2 series if you really really think spending $10k on a laptop mac to do inferrence slowly (but faster than a plain PC of course) make sense.