3 ms·
"controlled cloud" hmm. aside from a future where completely offline LLMs are in the car, with over the air updates being done to the full model if its too cra
by yieldcrv 3y ago
"controlled cloud" hmm.
aside from a future where completely offline LLMs are in the car, with over the air updates being done to the full model if its too crazy, maybe we could do dual LLMs. where a dumber, slower, offline one is there when connection is bad or not available.
- sroussey 3y agoThat sounds like what apple does for voice to text. It runs on device and in the cloud. The cloud can then make corrections to the smaller model that runs on device.