3 ms·
>At some point you hit bandwidth limitations Yes, with HBM3 you could go up to 5TB/s and in the future 6.4TB/s. To give a comparison a 3980 RTX Ti has ~900 GB/
by ksec 5y ago
>At some point you hit bandwidth limitations
Yes, with HBM3 you could go up to 5TB/s and in the future 6.4TB/s. To give a comparison a 3980 RTX Ti has ~900 GB/s with GDDR6x.
But just with everything we hit TDP or cost ceiling well before any technical barriers.