11 ms·For text inference, what you want is M1/M2 Ultra with its 800 Gb/s RAM. Max only goes up to 400 Gb/s.by int_19h 3y agoFor text inference, what you want is M1/M2 Ultra with its 800 Gb/s RAM. Max only goes up to 400 Gb/s.ls612 3y agoYeah but the ultra only goes in desktop platforms which may be limiting to some.int_19h 3y agoBut that's no different from mid-to-high-end GPUs, which is what the original ask was about.