3 ms·
> An engineer More like a dozen of engineers over a couple of weeks. Make sure popular LLMs can run on their hardware, as well as Stable Diffusion and other po
by qwertox 3y ago
> An engineer
More like a dozen of engineers over a couple of weeks. Make sure popular LLMs can run on their hardware, as well as Stable Diffusion and other popular projects, and then they will see consumers flock to their hardware.
With consumers I mean something like what "gamers" used to be during all these past decades (and still are), those who won't be using it for business cases (what Quadro used to be) but for their hobby; this, but oriented towards AI, which currently is limited to LLM, image generation and ASR.
If they focus on this, the community will start helping, maybe even cleaning up their mess of repositories they have on GitHub.
There are two benefits over Nvidia: They have more VRAM and they have an open source software stack.
They just need to get the basics working for all those hobbyists, those who want to run little projects on their home hardware.