2 ms·
The next frontier is conditional generation. The CTRL model (https://github.com/salesforce/ctrl https://github.com/salesforce/ctrl) with a similar architecture
by minimaxir 7y ago
The next frontier is conditional generation. The CTRL model (https://github.com/salesforce/ctrl https://github.com/salesforce/ctrl) with a similar architecture to GPT-2 emphasizes conditional generation (e.g. generate a news article based on a URL) and the results are pretty good: https://minimaxir.com/2019/09/ctrl-fake-news/ https://minimaxir.com/2019/09/ctrl-fake-news/