3 ms·
Not saying you're right/wrong, but argument from the other side: Apple's hardware ships with hardware specifically for ML, and a lot of it (maybe even all of th
by capableweb 3y ago
Not saying you're right/wrong, but argument from the other side: Apple's hardware ships with hardware specifically for ML, and a lot of it (maybe even all of the recently released?) has shared memory between GPU/CPU, meaning you could run larger models. Windows/Linux is currently stuck with having to run inference with either RAM or VRAM, limiting the options quite a bit.