3 ms·

My 2080Ti is still holding up reasonably well, helped by the fact I only run 1440p, but it's also doing OK for inference[1]. Though my "must have shiny new thin

My 2080Ti is still holding up reasonably well, helped by the fact I only run 1440p, but it's also doing OK for inference[1]. Though my "must have shiny new things" craving is getting hard to ignore. Considered getting a new GPU earlier this year but then realized 5xxx was "around the corner", but now it seems they're pushed back to next year. And with AI being what it is, I'm guessing prices won't drop significantly. Would be nice if AMD could get their GPU act together so it was a more viable alternative, NVIDIA could do with some competition. edit: just recalled I had a dual-chip GPU back in the day, the ATI 4870X2[2]. Though that was more like two GPUs glued to one PCB, so effectively "single card SLI". Hopefully the 5090 would be a better experience, as my 4870X2 never quite lived up to what it could theoretically do. [1]: https://www.pugetsystems.com/labs/articles/llm-inference-consumer-gpu-performance/ https://www.pugetsystems.com/labs/articles/llm-inference-con... [2]: https://www.techpowerup.com/gpu-specs/radeon-hd-4870-x2.c236 https://www.techpowerup.com/gpu-specs/radeon-hd-4870-x2.c236

throwaway48476 2y ago
Sadly AMD has given up on the high end. Which is the worst timing because desktop GPU sales are increasingly used for AI.
- jauntywundrkind 2y ago
  They had a multi-chip consumer flagship for the next rdna4, but it was reportedly having lots of problems. I do think games have a lot more vary needs than most AI - which primarily need to crunch matrixes - so I'm a little sympathetic to a jump to many-chip failing. You also burn power on chip to chip interconnect, try as we might to ever optimize this down. > Which is the worst timing because desktop GPU sales are increasingly used for AI. Well, the good news is RDNA4 is the last consumer chips. Good news because they are merging RDNA with CDNA (compute/ai) to make a new UDNA (unified), which all next next gen chips will be. https://www.tomshardware.com/pc-components/cpus/amd-announces-unified-udna-gpu-architecture-bringing-rdna-and-cdna-together-to-take-on-nvidias-cuda-ecosystem https://www.tomshardware.com/pc-components/cpus/amd-announce...

throwaway48476 2y ago

Sadly AMD has given up on the high end. Which is the worst timing because desktop GPU sales are increasingly used for AI.

jauntywundrkind 2y ago
They had a multi-chip consumer flagship for the next rdna4, but it was reportedly having lots of problems. I do think games have a lot more vary needs than most AI - which primarily need to crunch matrixes - so I'm a little sympathetic to a jump to many-chip failing. You also burn power on chip to chip interconnect, try as we might to ever optimize this down. > Which is the worst timing because desktop GPU sales are increasingly used for AI. Well, the good news is RDNA4 is the last consumer chips. Good news because they are merging RDNA with CDNA (compute/ai) to make a new UDNA (unified), which all next next gen chips will be. https://www.tomshardware.com/pc-components/cpus/amd-announces-unified-udna-gpu-architecture-bringing-rdna-and-cdna-together-to-take-on-nvidias-cuda-ecosystem https://www.tomshardware.com/pc-components/cpus/amd-announce...