This product is competing against NVidia for the deep learning space, not AMD. NV’s A100 features enormous memory bandwidth (1.4 TB/s) thanks to HBM and peak f

This product is competing against NVidia for the deep learning space, not AMD. NV’s A100 features enormous memory bandwidth (1.4 TB/s) thanks to HBM and peak flops (300 TFlops/s) thanks to tensor cores, so using HBM and Advanced Matrix Extensions here is pretty clearly aimed at that segment.