5 ms·
What would happen if an existing LLM were trained with the ability to emit a backspace token? (Would that even be possible?)
by cout 3y ago
What would happen if an existing LLM were trained with the ability to emit a backspace token? (Would that even be possible?)
- jgtrosh 3y agoNo idea, but this makes me wonder how we'd even go about getting training data. And it reminds me one time I built a poc editor[0] which saves deleted content so you can get a similar view to manuscripts in which the author strikes out text. Maybe that would be an interesting starting point… [0]: https://github.com/trosh/nohide https://github.com/trosh/nohide