3 ms·
I also consume all the heavily sibsidized LLM tokens I can find a use for. Great deal for us, the people who funded it? Not so fun.
by benreesman 1y ago
I also consume all the heavily sibsidized LLM tokens I can find a use for. Great deal for us, the people who funded it?
Not so fun.
- torginus 1y agoLLMs also cost what they cost because NVIDIA won't sell you a 5090 upgraded with 80GB RAM for $3000 instead of $2000 (which is overkill in the first place). Yo have to buy a H200 for $40000
- m4rtink 1y agoIf there is demand, someone will sell that eventually - while NVIDIA has a headstart, they "just" fab stuff on TSMC anyway. AMD and to a degree Intel are already starting to sell cards with more VRAM.
- Henchman21 1y agoApparently you can get these on the black market in China, at least according to “Gamers Nexus” https://m.youtube.com/watch?v=1H3xQaf7BFI https://m.youtube.com/watch?v=1H3xQaf7BFI