7 ms·10B * 2000 t/s = 20,000 GB/s memory bandwidth . Apple hardware can do 1k GB/s .by coolspot 1y ago10B * 2000 t/s = 20,000 GB/s memory bandwidth . Apple hardware can do 1k GB/s .oezi 1y agoThat’s why MoE is needed.