5 ms·

Because the market of people who want huge RAM GPUs for home AI tinkering is basically about 3 Hacker News posters. Who probably won’t buy one because it doesn’

Because the market of people who want huge RAM GPUs for home AI tinkering is basically about 3 Hacker News posters. Who probably won’t buy one because it doesn’t support CUDA. PS5 has something like 16GB unified RAM, and no game is going to really push much beyond that in VRAM use, we don’t really get Crysis style system crushers anymore.

bilekas 1y ago
> PS5 has something like 16GB unified RAM, and no game is going to really push much beyond that in VRAM use, we don’t really get Crysis style system crushers anymore. This isn't really true from the recreational card side, nVidia themselves are reducing the number of 8GB models as a sign of market demand [1]. Games these days are regularly maxing out 6 & 8 GB when running anything above 1080p for 60fps. The prevalence of Unreal Engine 5 also recently with a low quality of optimization for weaker hardware is causing games to be released basically unplayable for most. For recreational use the sentiment is that 8GB is scraping the bottom of the requirements. Again this is partly due to bad optimizations, but games are being played in higher resolutions also, which required more memory for larger texture sizes. [1] https://videocardz.com/newz/nvidia-reportedly-reduces-supply-of-rtx-5060-and-rtx-5060-ti-8gb https://videocardz.com/newz/nvidia-reportedly-reduces-supply...
- deleted 1y ago
  [deleted]
- pjmlp 1y ago
  As someone that started on 8 bit computing, Tim Sweeny is right the Electron garbage culture when applied to Unreal 5 is one of the reasons so much RAM is needed, with such bad performance. While I dislike some of the handmade hero culture, in one thing they are right, regarding how bad modern hardware happens to be used.
  - anthk 1y ago
    I remember UE1 being playable even software mode, such as the first Deus EX. Now, I think the Surreal Engine (UE1 reimplementation) needs damn GL 3.3 (if not 4.5 and Vulkan) to play games I used to play in an Athlon. Now I can't use surreal to Play DX on my legacy n270 netbook with GL 2.1... something that was more than enough to play the game at 800x600 with everything turned on and much more. A good thing is that I turned myself into libre/indie gaming with games such as Cataclysm DDA:Bright Ness with far less requeriments than a UE5 game and yet being enyojable due to playability and in-game lore (and a proper ending compared to vanilla CDDA).
    - keyringlight 1y ago
      UE1 was in the timeframe that 3D acceleration was only starting to get adopted, and IIRC from some interview Epic continued with a software option for UT2003/2004 (licensed pixomatic?) because they found out a lot of players were still playing their games on systems where full GPUs weren't always available, such as laptops. I know this is going back to Intel's Larrabee where they tried it, but I'd be real interested to see what the limits of a software renderer is now considering the comparative strength of modern processors and amount of multiprocessing. While I know there's DXVK or projects like dgVoodoo2 which can be an option with sometimes better backwards compatibility, just software would seem like a stable reference target than the gradually shifting landscape of GPUs/drivers/APIs
      - pjmlp 1y ago
        One possible way would be to revisit such ideas while using AVX-512, the surviving pieces out of Larrabee.
        anthk 1y ago
        llvmpipe/lavapipe under MESA, too. Lavapipe on Vulkan makes VKQuake playable even con Core Duo 2 systems. Just as a concept, of course. I know about software rendered Quakes since forever.
    - pjmlp 1y ago
Rohansi 1y ago
> PS5 has something like 16GB unified RAM, and no game is going to really push much beyond that in VRAM use That's pretty funny considering that PC games are moving more towards 32GB RAM and 8GB+ VRAM. The next generation of consoles will of course increase to make room for higher quality assets.
- pjmlp 1y ago
  In many cases due to bad programming, fixed by adding more RAM.
  - Rohansi 1y ago
    Sure, but not always. Future games will have more detailed assets which will require more memory. Running at 4K or higher resolution will be more common which also requires more memory.
    - pjmlp 1y ago
      "Because in the real world, I have to write up lists of stuff I have to go to the grocery store to buy. And I have never thought to myself that realism is fun. I go play games to have fun." Gabe Newell - https://www.gamesradar.com/gabe-newell-says-games-dont-need-to-be-realistic-i-have-never-thought-to-myself-that-realism-is-fun/ https://www.gamesradar.com/gabe-newell-says-games-dont-need-... Detailed assets don't equate good games.
      - Rohansi 1y ago
        Doesn't mean games are going to abandon realistic graphics styles. I also believe Gabe Newell was referring more to gameplay mimicking real life rather than art style. Makes a lot more sense when you remember that the Half Life games have a realistic art style and pushed limits of what was capable at the time.
FirmwareBurner 1y ago
>Because the market of people who want huge RAM GPUs for home AI tinkering is basically about 3 Hacker News posters You're wrong. It's probably more like 9 HN posters.
- blitzar 1y ago
  There are also 3 who, for retro reasons, want GPUs to have 8 bits and 256MB or less of VRAM
  - pjmlp 1y ago
    Yeah, https://tixl.app/ https://tixl.app/
  - anthk 1y ago
    With 256M of VRAM you can play HD videos.
jantuss 1y ago
Another use for high RAM GPUs is the simulation of turbulent flows for research. Compared to CPU, GPU Navier-Stokes solvers are super fast, but the size of the simulated domain is limited by the RAM.
epolanski 1y ago
I really doubt your claim considering how many people I've seen buy 5k Macbooks Pros with 48+ GB of ram for local inference. 500$ 32GB consumer GPU is an obvious best seller. Thus let's call it how it is: they don't want to cannibalize their higher end GPUs.
- pjmlp 1y ago
  Since I never used a laptop that was more than 2 000 euros, what a great set of salaries. Here is a better idea what to do with all that money, https://themarcooffset.com/ https://themarcooffset.com/
wpm 1y ago
This isn’t a gaming card, so what the PS5 does or has is not relevant here.
fnord77 1y ago
Marketing is misreading the room. I believe there's a bunch of people buying no video cards right now that would if there were high vram options available
paool 1y ago
Maybe today, but the more accessible and affordable they become, the more likely people can start offering "self hosted" options. We're already seeing competitors of AWS but only targeting things like Qwen , deepseek, etc. There's Enterprise customers who have compliance laws and literally want AI but cannot use any of the top models because everything has to be run on their own infrastructure.

bilekas 1y ago

> PS5 has something like 16GB unified RAM, and no game is going to really push much beyond that in VRAM use, we don’t really get Crysis style system crushers anymore. This isn't really true from the recreational card side, nVidia themselves are reducing the number of 8GB models as a sign of market demand [1]. Games these days are regularly maxing out 6 & 8 GB when running anything above 1080p for 60fps. The prevalence of Unreal Engine 5 also recently with a low quality of optimization for weaker hardware is causing games to be released basically unplayable for most. For recreational use the sentiment is that 8GB is scraping the bottom of the requirements. Again this is partly due to bad optimizations, but games are being played in higher resolutions also, which required more memory for larger texture sizes. [1] https://videocardz.com/newz/nvidia-reportedly-reduces-supply-of-rtx-5060-and-rtx-5060-ti-8gb https://videocardz.com/newz/nvidia-reportedly-reduces-supply...

deleted 1y ago
[deleted]
pjmlp 1y ago
As someone that started on 8 bit computing, Tim Sweeny is right the Electron garbage culture when applied to Unreal 5 is one of the reasons so much RAM is needed, with such bad performance. While I dislike some of the handmade hero culture, in one thing they are right, regarding how bad modern hardware happens to be used.
- anthk 1y ago
  I remember UE1 being playable even software mode, such as the first Deus EX. Now, I think the Surreal Engine (UE1 reimplementation) needs damn GL 3.3 (if not 4.5 and Vulkan) to play games I used to play in an Athlon. Now I can't use surreal to Play DX on my legacy n270 netbook with GL 2.1... something that was more than enough to play the game at 800x600 with everything turned on and much more. A good thing is that I turned myself into libre/indie gaming with games such as Cataclysm DDA:Bright Ness with far less requeriments than a UE5 game and yet being enyojable due to playability and in-game lore (and a proper ending compared to vanilla CDDA).
  - keyringlight 1y ago
    UE1 was in the timeframe that 3D acceleration was only starting to get adopted, and IIRC from some interview Epic continued with a software option for UT2003/2004 (licensed pixomatic?) because they found out a lot of players were still playing their games on systems where full GPUs weren't always available, such as laptops. I know this is going back to Intel's Larrabee where they tried it, but I'd be real interested to see what the limits of a software renderer is now considering the comparative strength of modern processors and amount of multiprocessing. While I know there's DXVK or projects like dgVoodoo2 which can be an option with sometimes better backwards compatibility, just software would seem like a stable reference target than the gradually shifting landscape of GPUs/drivers/APIs
    - pjmlp 1y ago
      One possible way would be to revisit such ideas while using AVX-512, the surviving pieces out of Larrabee.
      - anthk 1y ago
        llvmpipe/lavapipe under MESA, too. Lavapipe on Vulkan makes VKQuake playable even con Core Duo 2 systems. Just as a concept, of course. I know about software rendered Quakes since forever.
  - pjmlp 1y ago

Rohansi 1y ago

> PS5 has something like 16GB unified RAM, and no game is going to really push much beyond that in VRAM use That's pretty funny considering that PC games are moving more towards 32GB RAM and 8GB+ VRAM. The next generation of consoles will of course increase to make room for higher quality assets.

pjmlp 1y ago
In many cases due to bad programming, fixed by adding more RAM.
- Rohansi 1y ago
  Sure, but not always. Future games will have more detailed assets which will require more memory. Running at 4K or higher resolution will be more common which also requires more memory.
  - pjmlp 1y ago
    "Because in the real world, I have to write up lists of stuff I have to go to the grocery store to buy. And I have never thought to myself that realism is fun. I go play games to have fun." Gabe Newell - https://www.gamesradar.com/gabe-newell-says-games-dont-need-to-be-realistic-i-have-never-thought-to-myself-that-realism-is-fun/ https://www.gamesradar.com/gabe-newell-says-games-dont-need-... Detailed assets don't equate good games.
    - Rohansi 1y ago
      Doesn't mean games are going to abandon realistic graphics styles. I also believe Gabe Newell was referring more to gameplay mimicking real life rather than art style. Makes a lot more sense when you remember that the Half Life games have a realistic art style and pushed limits of what was capable at the time.

FirmwareBurner 1y ago

>Because the market of people who want huge RAM GPUs for home AI tinkering is basically about 3 Hacker News posters You're wrong. It's probably more like 9 HN posters.

blitzar 1y ago
There are also 3 who, for retro reasons, want GPUs to have 8 bits and 256MB or less of VRAM
- pjmlp 1y ago
  Yeah, https://tixl.app/ https://tixl.app/
- anthk 1y ago
  With 256M of VRAM you can play HD videos.

jantuss 1y ago

Another use for high RAM GPUs is the simulation of turbulent flows for research. Compared to CPU, GPU Navier-Stokes solvers are super fast, but the size of the simulated domain is limited by the RAM.

epolanski 1y ago

I really doubt your claim considering how many people I've seen buy 5k Macbooks Pros with 48+ GB of ram for local inference. 500$ 32GB consumer GPU is an obvious best seller. Thus let's call it how it is: they don't want to cannibalize their higher end GPUs.

pjmlp 1y ago
Since I never used a laptop that was more than 2 000 euros, what a great set of salaries. Here is a better idea what to do with all that money, https://themarcooffset.com/ https://themarcooffset.com/

wpm 1y ago

This isn’t a gaming card, so what the PS5 does or has is not relevant here.

fnord77 1y ago

Marketing is misreading the room. I believe there's a bunch of people buying no video cards right now that would if there were high vram options available

paool 1y ago

Maybe today, but the more accessible and affordable they become, the more likely people can start offering "self hosted" options. We're already seeing competitors of AWS but only targeting things like Qwen , deepseek, etc. There's Enterprise customers who have compliance laws and literally want AI but cannot use any of the top models because everything has to be run on their own infrastructure.