I think this is too harsh. It is technology with good uses but also limitations, just like all other technology. I'd say use it, but don't trust it fully. Ha

I think this is too harsh. It is technology with good uses but also limitations, just like all other technology. I'd say use it, but don't trust it fully. Hallucination seems a consequence of it being incapable to say: I don't know. Messy code is a problem with good enough answers to make it less of a risk to go completely of the rails. Also, weirdly, you can ask it to look critically at its own answer, and give edge cases. But at the end of the day, I am responsible for the SQL, not ChatGPT. I have to look over the response, test it,... A non-trivial amount of time. ChatGPT is a great tool but not magic. See also the now infamous case of the lawyer with the hallucinated precedents. It is a good idea for a lawyer to let ChatGPT do some research. But what went wrong was the validation: Someone should have looked up the cited case law, and noticed they were hallucinations. This is misuse of a good but not perfect tool.