2 ms·
I mean democratization in that people can buy a 4080 or 4090 and run and thinker with AI/LLMs themselves.
by 2OEH8eoCRo0 3y ago
I mean democratization in that people can buy a 4080 or 4090 and run and thinker with AI/LLMs themselves.
- dagmx 3y agoI think that’s too much of a minority to hold up a market. The real key will be client side inference. And as more chips go the route of the Apple ones with onboard inference, I think it’ll be more appealing to the mass market. Running LLMs locally on high end GPUs is going to always be niche.