4 ms·
Tested your example, the confidence is 0. In smart home context, I can think of an application where the low confidence answers can be forwarded to cloud, where
by ocihangir 2mo ago
Tested your example, the confidence is 0. In smart home context, I can think of an application where the low confidence answers can be forwarded to cloud, whereas the vast majority generic queries solved locally, if the confidence is reliable enough. The response is quite fast by the way.
- ComputerGuru 2mo agoBut this isn’t a query that should need to be forwarded to the cloud for acting on!
- goodmythical 2mo agoI don't know, the back of my napkin says you'll need consensus of at least three servers in order to complete the command.
- ocihangir 2mo agoIt is a 14MB model. You don’t need servers to run it. Check your napkin well.
- goodmythical 2mo agoI am sorely dissappointed that the state of the internet has become such that my sarcasm was not only possibly but actually missed.
- ocihangir 2mo agoMine too! I was not serious. I was just answering your napkin joke. But when I reread now, it is not that obvious. I guess with text you can pass only so much of emotions.
- goodmythical 2mo agoAh no harm, then. I considered /s, but I really thought it should be plain that I'm not crazy enough to believe one would need any more than a single local device to process such a relatively low complexity command.
- ocihangir 2mo agoConsidering this is a 14MB model running almost in a microcontroller, I am fine with such ‘ambigiuous’ queries cannot be handled, as long as the model confidence score is accurate. By the way, I did not test this model thoroughly. I am speculating on the potential of a small model like this. I don’t know if this one is good enough or not.