4 ms·
We keep making more intensive games and applications that tax the gpu more. LLMs have already kicked off another 5 year cycle of upgrades before they run full s
by kanwisher 2y ago
We keep making more intensive games and applications that tax the gpu more. LLMs have already kicked off another 5 year cycle of upgrades before they run full speed on consumer hardware
- citizenpaul 2y agoIsn't one of the issues with local LLM the huge amount of GPU memory needed? I'd say that we'll go a lot longer than 5 years before phones have 24+GB of VRAM.
- jerlam 2y agoIt's very questionable whether consumers want to spend the money to run LLMs on local hardware; nor do companies want them to, instead of charging a subscription fee. High-end PC gaming is still a small niche. Every new and more powerful gaming console does worse than the previous generation. VR hasn't taken off to a significant degree.