2 ms·
Not a hardware engineer, but it's mainly because of RAM wires/channels (not implying that this is "simple" form an engineering perspective). Using the publishe
by pizza234 1mo ago
Not a hardware engineer, but it's mainly because of RAM wires/channels (not implying that this is "simple" form an engineering perspective).
Using the published bandwidths, the math is 170 * 1 and 153 * 8.
- embedding-shape 1mo agoBut 170GB/s is almost nothing? None of the RTX 50 series GPUs has that low bandwidth, you have to go back two generations of nvidia GPUs to get closer to that, and then it's the cheapest of the series, RTX 3050, which has ~170GB/s. Even the GTX 1080, launched ten years ago, has double the bandwidth! This must be some different way of measuring the bandwidth right? Since they explicitly say this for AI, but the numbers they share don't show that at all. Or I gravely misunderstand something here.
- pizza234 1mo ago> Since they explicitly say this for AI That's marketing spin indeed (or lies, if you prefer).