In the grand scheme of things it's ancient history, but https://code-as-policies.github.io/ https://code-as-policies.github.io/ works by generating code then ex

In the grand scheme of things it's ancient history, but https://code-as-policies.github.io/ https://code-as-policies.github.io/ works by generating code then executing it. That's worth running at. The code generation in that paper was done on code-davinci-002, which is (or rather was - it's deprecated) a 15B GPT-3 model. I've not done it yet, but I'd expect the open source 7B code completion models to be able to replicate it by now.