3 ms·
Here’s a paper that constitutes the state of the art in this domain in 2018. [1] They trained a model on a corpus, and the results were about 50% accurately exe
by comfypotato 3y ago
Here’s a paper that constitutes the state of the art in this domain in 2018. [1] They trained a model on a corpus, and the results were about 50% accurately executed commands. That’s only single commands (not complete scripts) and you couldn’t go back and forth with NL2Bash to fix mistakes.
I think this is a great example of the strides of LLMs. It’s absolutely leaps and bounds ahead of what was unwieldily cutting edge just 5 years ago.
https://homes.cs.washington.edu/~mernst/pubs/nl2bash-corpus-lrec2018.pdf https://homes.cs.washington.edu/~mernst/pubs/nl2bash-corpus-...