Two reasons why it's a bad idea: 1. ChatGPT can't be held responsible, it has no body, like summoning the genie from the lamp, and about as sneaky with its har

Two reasons why it's a bad idea: 1. ChatGPT can't be held responsible, it has no body, like summoning the genie from the lamp, and about as sneaky with its hard to detect errors 2. ChatGPT is not autonomous, not even a little, these models can't recover from error on their own. And their input buffers are limited in size, and don't work all that well when stretched at maximum Especially the autonomy part is hard. Very hard in general. LLMs need to become agents to collect experience and learn, just training on human text is not good enough, it's our experience not theirs. They need to make their own mistakes to learn how to correct themselves.