3 ms·
I want to see an LLM that generates answers without the letter 'e', like the novel Gadsby by Ernest Vincent Wright.
by queuebert 2y ago
I want to see an LLM that generates answers without the letter 'e', like the novel Gadsby by Ernest Vincent Wright.
- eru 2y agoIf you had one that was character based (instead of the weird encoding they tend to use), you could directly sample without e. Though I'm not sure its output would make much sense, and you might have to use beam search (or something like backtracking). I wonder how you would train a model to directly speak without e. Perhaps you use the general model like above with beamsearch, and then train a new model to directly predict the first models beamsearched-predictions.