3 ms·
> Everyone is going crazy about edge AI, what am I missing? If you clone a model and then bake in a more expensive model's correct/appropriate responses to you
by gopher_space 2y ago
> Everyone is going crazy about edge AI, what am I missing?
If you clone a model and then bake in a more expensive model's correct/appropriate responses to your queries, you now have the functionality of the expensive model in your clone. For your specific use case.
The size of the resulting case-specific models are small enough to run on all kinds of hardware, so everyone's seeing how much work can be done on their laptop right now. One incentive for doing so is that your approaches to problems are constrained by the cost and security of the Q&A roundtrip.