3 ms·
Yes, it's a nefarious plot of AI producers to attempt a monopoly with a product that no one seems capable of demonstrating has the exponential value they're bet
by cyanydeez 9mo ago
Yes, it's a nefarious plot of AI producers to attempt a monopoly with a product that no one seems capable of demonstrating has the exponential value they're betting on.
- adornKey 9mo agoOnce everybody has a decent amount of VRAM they can just run local AIs and the need to mess with Ad-laden search results will fizzle. So of course they are desperate to grab a new monopoly. People haven't realised yet, that local AIs are fast and produce good results - on pretty average hardware. If they don't manage to grab a new monopoly Google will be history. But it doesn't really need a nefarious plot for the price spikes. There is a serious lack of VRAM deployed out there. Filling that gap will take quite some time. Add to that the nefarious plot and the situation will most likely get even worse....
- mrob 9mo agoLLM inference is mostly read only, so high-bandwidth flash looks like it could provide huge cost savings over VRAM. It's not yet in commercial products but there are working prototypes already. Previous HN discussion: https://news.ycombinator.com/item?id=46700384 https://news.ycombinator.com/item?id=46700384
- whosegotit 9mo agoAre you saying that intel’s optane product was just ahead of its time? Is optane the answer to LLM’s ever increasing appetite?
- jug 9mo agoAI companies yes, RAM manufacturers no.