3 ms·
This looks very cool. It says on the website "Predict the next word(s) from a given sequence of words." Speaking as someone who has very little programming kno
by ghoomketu 6y ago
This looks very cool.
It says on the website "Predict the next word(s) from a given sequence of words." Speaking as someone who has very little programming knowledge, would it be possible to use this to create a gmail like auto-complete with this? If so, how can I make it so that the words generated resemble my own writing style (like gmail auto-complete does?).
- knicholes 6y agoYou fine-tune the end layers of the network with your own writing. This, however, requires the model.
- edunteman 6y agoWorking on a fine-tuning add-on currently :) The one I'm working with is called PPLM by Uber eng, and it takes a "bag of words" to keep generated text on topic. It's not exactly what you're asking for (style transfer), but you'd be able to load it with your common email phrases, and the postprocessing will bias similar phrases, keeping it somewhat stylistically consistent.
- edunteman 6y agoWorking on a feature that allows you to define your common phrases, and it'd bias the output toward that. See my response to knicholas in this thread. It's not a perfect fix but would work. Other APIs I launch in the future should help. BERT comes to mind. You could generate multiple options using GPT2, then have BERT assess if they're in your style.