4 ms·
These LLMs are trained with lots and lots of text from many sources, 99.9+% of which do not contain backspaces. They could theoretically output them, given the
by Hendrikto 4y ago
These LLMs are trained with lots and lots of text from many sources, 99.9+% of which do not contain backspaces. They could theoretically output them, given the right tokenizer, but they don‘t.
And they especially don‘t do it to correct errors.
- cma 4y agoThey could potentially be trained on applying diffs though. Wikipedia has full source control version history of how things evolved, and so do most of the source code corpuses they use like github. Google has keystroke by keystroke history of all google docs, could pull an Adobe Stock and opt everyone in with some TOS update but the blowback would be huge.