3 ms·
LLMs also cost what they cost because NVIDIA won't sell you a 5090 upgraded with 80GB RAM for $3000 instead of $2000 (which is overkill in the first place). Yo
by torginus 1y ago
LLMs also cost what they cost because NVIDIA won't sell you a 5090 upgraded with 80GB RAM for $3000 instead of $2000 (which is overkill in the first place). Yo have to buy a H200 for $40000
- m4rtink 1y agoIf there is demand, someone will sell that eventually - while NVIDIA has a headstart, they "just" fab stuff on TSMC anyway. AMD and to a degree Intel are already starting to sell cards with more VRAM.
- Henchman21 1y agoApparently you can get these on the black market in China, at least according to “Gamers Nexus” https://m.youtube.com/watch?v=1H3xQaf7BFI https://m.youtube.com/watch?v=1H3xQaf7BFI