5 ms·
I liked this part: "one small step at a time, and one giant leap, together." I didn't like this part: 5090 for $2000, about $500 more than 4090 when
by behnamoh 2y ago
I liked this part:
"one small step at a time, and one giant leap, together."
I didn't like this part:
5090 for $2000, about $500 more than 4090 when it was announced.
They didn't mention VRAM amount though, and I doubt it's more than 24GB. If Apple M4 Ultra gets close to 1.8 TB/s bandwidth of 5090, it'll crush GeForce once and for all (and for good).
Also nitpick: the opening video said tokens are responsible for all AI, but that only applies to a subset of AI models...
- jsheard 2y agoIt's 32GB, that was leaked well before the event. > If Apple M4 Ultra gets close to 1.8 TB/s bandwidth of 5090 If past trends hold (Ultra = 2x Max) it'll be around 1.1 TB/s, so closer to the 4090.
- behnamoh 2y agoJensen didn't talk about it. Maybe he knows it's embarrassingly low. Everyone knows nvidia won't give us more VRAM to avoid cannibalizing their enterprise products.
- deleted 2y ago[deleted]
- aseipp 2y agoThe official specs for the 5090 have been out for days on nvidia.com, and they explicitly state it's 32GB of GDDR7 with a 512-bit bus, for a total of 1.8TB/s of bandwidth.
- behnamoh 2y ago32GB is still not a lot.
- BryanLegend 2y ago"640k should be enough for anybody"
- Jedd 2y agoThis feels like a weird complaint, given you started by saying it was 24GB, and then argued that the person who told you it was actually 32GB was making that up.
- behnamoh 2y agoLooks like Nvidia did a simple calculation: 32GB (for 5090) / 24GB (for 4090) ≃ 1.33 Then multiply 4090's price by that: $1500 × 1.33 ≃ $2000 All else equal, this means that price per GB of VRAM stayed the same. But in reality, other things improved too (like the bandwidth) which I appreciate. I just think that for home AI use, 32GB isn't that helpful. In my experience and especially for agents, models at 32B parameters just start to be useful. Below that, they're useful only for simple tasks.
- deleted 2y ago[deleted]
- Jedd 2y agoYes, home / hobbyist LLM users are not overly excited about this, but a) they are never going to be happy, b) it's actually a significant step up given the bulk are dual-card users anyway, so this bumps them from (at the high end of the consumer segment) 48GB to 64GB of VRAM, which _is_ pretty significant given the prevalence of larger models / quants in that space, and c) vendors really don't care terribly much about the home / hobbyist LLM market, no matter how much people in that market wish otherwise.
- xcv123 2y agoIt’s more enough for gaming. Buy their datacenter GPU if you need more VRAM.
- qingcharles 2y agoIt makes for a hard choice. M4 Ultra with say 128GB of RAM vs ... 2 x 5090 with 64GB of RAM for about the same price? More tokens/sec on the dual 5090, but way bigger model on the M4. Plus the dual 5090 might trip your breakers.
- smallmancontrov 2y agoIf anyone in this thread had watched the linked video or even read a summary, they ought to be at least talking about the DIGITS announcement. 128GB of VRAM for $3000. Slow? Yes. It isn't meant to compete with the datacenter chips, it's just a way to stop the embarrassment of being beaten at HPC workstations by apple, but it does the job.
- toshinoriyagi 2y agoedit: 32GB is confirmed here https://www.nvidia.com/en-us/geforce/graphics-cards/50-series/ https://www.nvidia.com/en-us/geforce/graphics-cards/50-serie... Supposedly, this image of a Inno3D 5090 box leaked, revealing 32GB of VRAM. It seems like the 5090 will be more of a true halo product, given the pricing of the other cards. https://www.techpowerup.com/330538/first-nvidia-geforce-rtx-5090-gpu-with-32-gb-gddr7-memory-leaks-ahead-of-ces-keynote https://www.techpowerup.com/330538/first-nvidia-geforce-rtx-...
- ksec 2y agoFor what 5090 is offering with 32GB RAM I thought it is a pretty decent price comparatively to 4090. I thought the whole lineup is really well priced.
- arresin 2y agoGood for image generation, inadequate for local llms (on its own).
- headcanon 2y agoMarket price for a 4090 is ~$2700 today: https://stockx.com/nvidia-founders-geforce-rtx-4090-24gb-graphics-card-900-1g136-2530-000 https://stockx.com/nvidia-founders-geforce-rtx-4090-24gb-gra... When you have a retail price so far below "street" price, it just makes it harder to obtain and scalpers take a bigger cut. Raising the price to something more normal at least gives you more of a chance at the big-box store.
- heyoni 2y agoOr scalpers won’t be dissuaded and street price for a 5090 will be $3200 or more. $1500 was already an insane price tag for scalpers to pay but they did it anyways.
- pertymcpert 2y agoThe scalpers are trying to arbitrage the difference in price between the prices bought directly from suppliers and those on the open secondary market. increasing the retail price doesn't increase the price on the secondary market, it just lowers the margin of scalpers.
- heyoni 2y agoGreat, so nothing changes.
- geokon 2y agovery naiive question... But why have a retail price at all and not just auction off batches to retailers (say 10 000 card at a time) Let the market set the price and only control how many cards you auction and when
- gbin 2y agoBeing able to decide a price and who you sell your product to is a huge leverage. Nvidia can go to a retailer selling something they don't like to be side by side on a shelf, hey ditch this and we will make you a price. It is never that overt of course and it can play geopolitically too, hey government you want chips? We have chips and it would be a shame if the market grabs them before you, BTW don't forget my tax cut.