3 ms·
It looks like that’s not the case anymore. That’s what this is all about.
by thefounder 2y ago
It looks like that’s not the case anymore. That’s what this is all about.
- senko 2y agoIt still is. The DeepSeek R1 is 670B parameters, requiring more than 300GB of video ram (or unified memory), even if using 4-bit quantized models.
- amazingamazing 2y agoHow much video RAM was needed for similar performance a year ago?
- senko 2y agoRoughly the same, as our collective goalposts have shifted, and are still shifting. What was amazing output last year is today's slop. NV is in no immediate danger; medium/long term, to anyone knowing what "75% gross margin" means it's no secret that there will be serious threats. You don't need DeepSeek for that particular realization.
- amazingamazing 2y agoWhich open source model last January gave you similar results with the same amount of video ram?
- talldayo 2y agoNomic Falcon, Mixtral, YALM, Bloom, Grok-1 and Jamba, just to name a few of the foundation models.