3 ms·

I like to use the OpenCL benchmarks as a rough point of comparison: https://browser.geekbench.com/opencl-benchmarks https://browser.geekbench.com/opencl-benchma

• senttoschool 3y ago
  It's a little bit more nuanced than that. First, OpenCL is basically deprecated at this point and only Metal is up to date. Second, M2 Max might have a lot more RAM available than a 4090 because of its unified memory architecture. It can have up to 96GB vs 24GB for the 4090. So we need to look at different RAM configurations.
  • smoldesu 3y ago
    > OpenCL is basically deprecated at this point By Apple. > unified memory architecture Not really a bottleneck when layering over PCI exists. You're only constrained by PCI bandwidth and memory speeds, neither of which are really slow enough to meaningfully impact AI inferencing performance. Honestly, disk speeds are the #1 AI bottleneck I've seen on older systems. > It can have up to 96GB vs 24GB for the 4090 Good, at the M2 Max's price point I could almost afford 4x 3090s anyways. I'd only need one to beat it in inferencing performance though.