The point being that: > With code interpreter, ChatGPT can check that it's code at least runs without errors is not a solution to gotchas/caveats that build u

The point being that: > With code interpreter, ChatGPT can check that it's code at least runs without errors is not a solution to gotchas/caveats that build up over time that ChatGPT won't know about. ChatGPT can warn about caveats from that line of code because it's old code. It does not have a magical defense that will allow it to warn about caveats, errors, security risks, or deprecations that are introduced after its knowledge cutoff. The best solution that we've been able to find so far is for ChatGPT to do a search and feed the results into its context. But that has its own problems, and importantly it only works if the underlying search engines are still returning up-to-date relevant results and documentation from sites like StackOverflow.