4 ms·
With code interpreter, ChatGPT can check that it's code at least runs without errors
by rolisz 3y ago
With code interpreter, ChatGPT can check that it's code at least runs without errors
- dharmab 3y agorm -rf $INSTALL_DIR/* this line of code has at least two gotchas. if you run it to test it out, there is a good chance you will destroy your data. It is otherwise a valid line of code. This is not a theoretical problem: https://github.com/valvesoftware/steam-for-linux/issues/3671 https://github.com/valvesoftware/steam-for-linux/issues/3671
- rolisz 3y agoChatGPT warns about gotchas with that line.
- danShumway 3y agoThe point being that: > With code interpreter, ChatGPT can check that it's code at least runs without errors is not a solution to gotchas/caveats that build up over time that ChatGPT won't know about. ChatGPT can warn about caveats from that line of code because it's old code. It does not have a magical defense that will allow it to warn about caveats, errors, security risks, or deprecations that are introduced after its knowledge cutoff. The best solution that we've been able to find so far is for ChatGPT to do a search and feed the results into its context. But that has its own problems, and importantly it only works if the underlying search engines are still returning up-to-date relevant results and documentation from sites like StackOverflow.
- treis 3y agoYes, but ultimately it's still a "statistically likely" answer and not the "right" one. Often the two overlap and maybe one day they'll make it an overlapping venn diagram. But that day is not today.