2 ms·
Perhaps I am more jaded because I am partially in this space, and I have a natural aversion to anything pitched as "democratization" because it's a salespitch w
by dagmx 3y ago
Perhaps I am more jaded because I am partially in this space, and I have a natural aversion to anything pitched as "democratization" because it's a salespitch word for "We want you to believe it will be mass market someday"
That's not to say democratizing abilities is not a worthy goal. I just don't think many of the companies rushing into this space really have a product vision that will end up being mass adopted.
- 2OEH8eoCRo0 3y agoI mean democratization in that people can buy a 4080 or 4090 and run and thinker with AI/LLMs themselves.
- dagmx 3y agoI think that’s too much of a minority to hold up a market. The real key will be client side inference. And as more chips go the route of the Apple ones with onboard inference, I think it’ll be more appealing to the mass market. Running LLMs locally on high end GPUs is going to always be niche.