3 ms·
If I tell my computer to "froblate" it says "command not found" not "command shutting down". If I tell it to "shtudown", it said "did you mean 'shutdown'? The
by hgsgm 4y ago
If I tell my computer to "froblate" it says "command not found" not "command shutting down".
If I tell it to "shtudown", it said "did you mean 'shutdown'?
There is an AI failure in distinguish "mispronounced command I know" from "command I don't know".
- lolinder 4y agoI'm not convinced that ChatGPT would do better than existing models in that regard. Using it for intent recognition is already a bit of a square peg round hole situation. Basic intent recognition models are trained to produce a single neuron per intent as the output, which makes it pretty easy to use the activation levels of the output to decide whether to perform an action, confirm an action, or ask for clarification. You just need to check if the certainty is below a certain threshold. With ChatGPT you'd have to encode the intents as text of some kind (JSON?) and hope that it doesn't just hallucinate an intent that your APIs don't have when it's faced with ambiguous input. You could probably have hallucinated intents map to a decent-sounding error message, but that feels more brittle to me than the existing approaches.