3 ms·

Are we constrained by RAM production? RAM Price per GB Projected to decline at 15% per annum. That's quite a few years before you'll get double the RAM. For

• hadlock 1y ago
  My guess was that nvidia is limiting memory size on consumer cards to avoid cannibalizing their commercial/industrial sales. I see no reason why a 5060 or 5070 can't come with 64/128/512gb memory outside of intentional decisions to not support those memory sizes; I don't need a 5090 as I don't need more than ~20-40 tokens/s as a 1-4 user household system