That's really a choice. I mean most machine learning models wind up outputting a confidence distribution over possible outputs, so it's up to the user to decide

That's really a choice. I mean most machine learning models wind up outputting a confidence distribution over possible outputs, so it's up to the user to decide how to extract an answer from that. They can and do have low confidence when they aren't sure.