"Arguing" with chat gpt in general will give you a good idea of how certain it is with it's answers. It often has a very incomplete or wrong knowledge of vario

"Arguing" with chat gpt in general will give you a good idea of how certain it is with it's answers. It often has a very incomplete or wrong knowledge of various apis and command line arguments. Asking if it's sure or telling it that it's wrong or pasting it an error message will get it to correct it's answer, but if you tell it that "Paris is definitely the capital of the UK" will not convince it to agree with you. Given the probable fact that information about certainty about facts is contained within the model _somewhere_, it'd be nice if it could better incorporate that into the answer. Like -- "I don't know the exact api, but I think the correct yaml should be something like this" would be much more useful than just spitting out the wrong yaml with complete confidence.