2 ms·
Yes though for inference memory bandwidth is more important than tflops. Not sure how Apple compares in that regard. The OP does train models too though which i
by wkat4242 2y ago
Yes though for inference memory bandwidth is more important than tflops. Not sure how Apple compares in that regard. The OP does train models too though which is more compute heavy.
- angoragoats 2y agoEach of the 3090s has something like 15% higher memory bandwidth than the whole M2 Ultra system does.