2 ms·
> Yes all this has been known since the M4 came out. The memory bandwidth is too low. The M4 Max with 128GB of RAM (the part used in the comment) has over 500G
by Aurornis 1y ago
> Yes all this has been known since the M4 came out. The memory bandwidth is too low.
The M4 Max with 128GB of RAM (the part used in the comment) has over 500GB/sec of memory bandwidth.
- zackify 1y agoWhich is incredibly slow when you’re over 20k context