4 ms·
For GenAI, I wonder if we need consumer hardware to be that powerful. Isn't this exactly what "the cloud" is for?
by wvenable 2y ago
For GenAI, I wonder if we need consumer hardware to be that powerful. Isn't this exactly what "the cloud" is for?
- aurareturn 2y agoI think the best models will always require "the cloud" but there will be plenty of use cases where "good enough" local LLMs need to be on-device.
- kmeisthax 2y agoIt depends. If you're OpenAI, consumer hardware should never be powerful enough to run local models. If you're Apple, it should.