4 ms·

Your limitation after prefill is memory bandwidth. A maxed out Studio has less than a single 3090 (really).

• sroussey 7mo ago
  Yeah, the 3090 has faster memory, but not by a lot. The 5090 is at 1,792GB/sec and potential M5 Ultra would be 1,230GB/sec and 512GB RAM. Maybe 1TB. Not 32.
  • thejazzman 7mo ago
    You’re suggesting that a difference of the entirety of the M5 Max’s bandwidth is an insignificant gap!
    • veidr 7mo ago
      No, that difference is the 5090, not the 3090.