3 ms·
Im not sure they have to compete. If they * Show local performance * Provide a way for other LLM providers to receive compensation for providing local models
by bnchrch 2y ago
Im not sure they have to compete.
If they
* Show local performance
* Provide a way for other LLM providers to receive compensation for providing local models
Then there are alot of use cases that get better with a local LLM instead of a remote LLM:
* Offline search
* Faster Text suggestion and transformation
* Client side AI assist for video games (This is better from a cost perspective for the game dev)
* Pushing the LLM runtime cost to the user