4 ms·
The M5 MBP has 24GB of RAM, more context in RAM perhaps?
by afzalive 2mo ago
The M5 MBP has 24GB of RAM, more context in RAM perhaps?
- gitpusher42 2mo agoThe process stays at around 2 GB with 16 slots and a 4K context on both the M5 and M2. But yeah, Apple might be doing some magic under the hood
- petu 2mo agoUnused RAM is wasted RAM. So not really Apple magic, about every OS uses "free" memory as disk cache. Try to leave only a gigabyte or two free, speed likely would drop dramatically. Edit: or do some calculation / logging of experts read speed, to see if it's faster than SSD spec.
- deleted 2mo ago[deleted]
- deleted 2mo ago[deleted]
- gitpusher42 2mo agoyeah, looks like a page cache matters a lot I tested on mine m5 pro with 8gb memory pressure, got 27t/s instead of 35t/s Someone tested on m4 max. In regular state it was 48tok/s, but 32-42 with memory pressure