A junior developer will figure out and hopefully confess when he's way over his head, but ChatGPT will happily respond "oh right you are, that makes no sense, h

A junior developer will figure out and hopefully confess when he's way over his head, but ChatGPT will happily respond "oh right you are, that makes no sense, here's a corrected version"—just to respond with a version that is also false in a way that might not be readily apparent. ChatGPT ultimately doesn't know what it doesn't know, unless it's been told so explicitly (this is my current understanding which may be flawed; I'd like to know the "not knowing" would otherwise work in this system!). But indeed it's still quite useful. It's best used in situations where it doesn't matter much if the answer is right, or when the answer can be easily checked if it's correct, yet more annoying to come up by oneself in the first place.