3 ms·
I'd like to share a particular case showing the necessity of verifying AI's work. Yesterday I asked o1-preview (the "best" reasoning AI on the market) how coul
by raincole 2y ago
I'd like to share a particular case showing the necessity of verifying AI's work.
Yesterday I asked o1-preview (the "best" reasoning AI on the market) how could I safely execute untrusted JavaScript code submitted by the user.
AI suggested a library called vm2, and gave me fully working code example. It's so good at programming that the code runs without any modifications from me.
However, then I looked up vm2's repository. It turns out to be an outdated project, abandoned due to security issues. The successor is isolated-vm.
The code AI gave me is 100% runnable. Had I not googled it, no amount of unit tests can tell me that vm2 is not the correct solution.