3 ms·

Nvidia GeForce GTX 980 Through GeForce RTX 5080/5090 GPU Compute Performance

28 points by mfiguiere 2y ago

nharada 2y ago
When I was in grad school doing research on the still brand new "deep learning", having a GTX TITAN X was considered bragging rights. I remember complaining to my advisor about my paltry GTX 970. One lab even had a cluster of 4 of them! Crazy that even the last generation cards are 15x faster for ML tasks.
aappleby 2y ago
It's a shame they didn't test the Titan V, it was released in 2017 yet still has the best FP64 performance of all the NVidia GPUs by a longshot.
- colechristensen 2y ago
  I assume this is for architectural reasons?
- michaellarabel 2y ago
  Titan V wasn't included since I never ended up receiving any Titan V review sample back in the day. :/
- Neywiny 2y ago
  I'd never seen this before but it is interesting. For the uninitiated, it has performance much higher weighted than others towards that metric. However, it only beats the GPUs. Looks like the more datacenter or professional cards completely outclass it. Seems to be similar FLOP/Joule, though. I'd bet that like AVX512 on Intel, they decided the money was in AI not more traditional scientific computing.
Havoc 2y ago
Wow hadn’t realised the 4090 is twice as fast as the 3090 at llama. I guess vram focus had lead me to believe they’re closer
m463 2y ago
People always talk about gpus being overpriced. The 980 was $549 in 2014, which seems to be about $730? today. that means the 5080 at $999 is 1.3x the price of the 980. Yet the geometric mean score is 8.5x. if you compare 980 vs 5090, you get 2.7x price, but 14.3x perf. I would imagine this must be pretty good compared to many other components. Well, cpus maybe, not sure about memory or hd/ssd.
- hot_gril 2y ago
  I only heard this during one of the brief cryptocurrency crazes when GPUs became very valuable, and it seemed true, seeing how I made a profit selling an RX580 I had bought new years before.
- dangus 2y ago
  It still feels like more because of the way the cost has risen to the person looking to buy that “median system.” If I spent in the $200s inflation adjusted on my processor 10 years ago I can spend about the same and expect to be in the sand place on the totem pole as before. It would be a mid-range to low mid-range CPU suitable for those sort of tasks. But if I spent $1362 in today’s money in 2013 I got the best graphics card available from Nvidia, the Titan X. Today the best card they sell costs $2,000.
- qball 2y ago
  >People always talk about gpus being overpriced. This is true, but only if you're exclusively considering the lower-end or comparing with consoles (which, let's be honest, most people are). The 3060/4060 are 400USD GPUs that promise the performance of a GTX1080Ti for half the MSRP (inflation-adjusted), but released 5-7 years later. The problem starts with just how absurdly good the 3080 and 4090 objectively are. Normally, you only get a 30% generational uplift with the newest-gen hardware (and the RTX5090 has indeed regressed to that 30% uplift mean, and that's partially why they had to add the extra memory); but the 3080 is a 100% uplift over the 2080Ti (and 3070) and the 4090 is another 100% uplift on top of the 3080 (and 4070). And you will recall that the 3080 was not twice the price of the 3070, and the 4090 was not twice the (inflation-adjusted) price of the 3080. Which is precisely the reason nVidia is taking its sweet time coming out with what the gaming market actually wants, which is a 3080 for 400USD. You can expect such a card to appear in 2029; we already know for certain the 5060Ti 8GB is just a 3070 (for the same non-inflation-adjusted MSRP, by the way), and following that pattern means the 6060 will be a 3070 for 400USD (and the 6060Ti a 3080 for 550), then the 7060 will finally match the 3080 at that price.
accrual 2y ago
It's neat to see the 4080 Super doing well compared to the 5080 and 5090. It's clearly behind them in many cases, but seems to have better performance per watt ratio than them while also having some of the lowest temps. Also interesting the regular 4080 isn't too far behind the Super. This was an enjoyable and clean dataset to read through, thanks Michael.
sebazzz 2y ago
Did anyone ever investigate if newer drivers cause older GPUs to perform worse?

28 points by mfiguiere 2y ago

When I was in grad school doing research on the still brand new "deep learning", having a GTX TITAN X was considered bragging rights. I remember complaining to my advisor about my paltry GTX 970. One lab even had a cluster of 4 of them! Crazy that even the last generation cards are 15x faster for ML tasks.

aappleby 2y ago

It's a shame they didn't test the Titan V, it was released in 2017 yet still has the best FP64 performance of all the NVidia GPUs by a longshot.

colechristensen 2y ago
I assume this is for architectural reasons?
michaellarabel 2y ago
Titan V wasn't included since I never ended up receiving any Titan V review sample back in the day. :/
Neywiny 2y ago
I'd never seen this before but it is interesting. For the uninitiated, it has performance much higher weighted than others towards that metric. However, it only beats the GPUs. Looks like the more datacenter or professional cards completely outclass it. Seems to be similar FLOP/Joule, though. I'd bet that like AVX512 on Intel, they decided the money was in AI not more traditional scientific computing.

Havoc 2y ago

Wow hadn’t realised the 4090 is twice as fast as the 3090 at llama. I guess vram focus had lead me to believe they’re closer

m463 2y ago

People always talk about gpus being overpriced. The 980 was $549 in 2014, which seems to be about $730? today. that means the 5080 at $999 is 1.3x the price of the 980. Yet the geometric mean score is 8.5x. if you compare 980 vs 5090, you get 2.7x price, but 14.3x perf. I would imagine this must be pretty good compared to many other components. Well, cpus maybe, not sure about memory or hd/ssd.

hot_gril 2y ago
I only heard this during one of the brief cryptocurrency crazes when GPUs became very valuable, and it seemed true, seeing how I made a profit selling an RX580 I had bought new years before.
dangus 2y ago
It still feels like more because of the way the cost has risen to the person looking to buy that “median system.” If I spent in the $200s inflation adjusted on my processor 10 years ago I can spend about the same and expect to be in the sand place on the totem pole as before. It would be a mid-range to low mid-range CPU suitable for those sort of tasks. But if I spent $1362 in today’s money in 2013 I got the best graphics card available from Nvidia, the Titan X. Today the best card they sell costs $2,000.
qball 2y ago
>People always talk about gpus being overpriced. This is true, but only if you're exclusively considering the lower-end or comparing with consoles (which, let's be honest, most people are). The 3060/4060 are 400USD GPUs that promise the performance of a GTX1080Ti for half the MSRP (inflation-adjusted), but released 5-7 years later. The problem starts with just how absurdly good the 3080 and 4090 objectively are. Normally, you only get a 30% generational uplift with the newest-gen hardware (and the RTX5090 has indeed regressed to that 30% uplift mean, and that's partially why they had to add the extra memory); but the 3080 is a 100% uplift over the 2080Ti (and 3070) and the 4090 is another 100% uplift on top of the 3080 (and 4070). And you will recall that the 3080 was not twice the price of the 3070, and the 4090 was not twice the (inflation-adjusted) price of the 3080. Which is precisely the reason nVidia is taking its sweet time coming out with what the gaming market actually wants, which is a 3080 for 400USD. You can expect such a card to appear in 2029; we already know for certain the 5060Ti 8GB is just a 3070 (for the same non-inflation-adjusted MSRP, by the way), and following that pattern means the 6060 will be a 3070 for 400USD (and the 6060Ti a 3080 for 550), then the 7060 will finally match the 3080 at that price.

accrual 2y ago

It's neat to see the 4080 Super doing well compared to the 5080 and 5090. It's clearly behind them in many cases, but seems to have better performance per watt ratio than them while also having some of the lowest temps. Also interesting the regular 4080 isn't too far behind the Super. This was an enjoyable and clean dataset to read through, thanks Michael.

sebazzz 2y ago

Did anyone ever investigate if newer drivers cause older GPUs to perform worse?