2 ms·
My suspicion is that this is simply due to the M5 having more memory, and the OS already having most of the file cached. The M2 has more memory pressure and wou
by wongarsu 3mo ago
My suspicion is that this is simply due to the M5 having more memory, and the OS already having most of the file cached. The M2 has more memory pressure and would cache fewer of the SSD reads
If that's true, inference speed would be even lower if you have only 2GB total, including OS caches
- GeekyBear 3mo agoThe base level M5 doesn't just have more memory than the base level M2. The memory bandwidth is bumped up by 50%, and the size of the on-die system level cache is bumped up by 50% as well.
- icedchai 3mo agoI recently got an M5 Air as a second machine. I question if I'll even need a Pro machine in the future, as long as I can get enough RAM with the base chip (which seems unlikely, but...)