3 ms·
Anyone have any ideas on how they're doing text insertion using an auto-regressive model?
by learndeeply 5y ago
Anyone have any ideas on how they're doing text insertion using an auto-regressive model?
- lucidrains 5y agoyes, they are most likely finetuning with this type of pretraining https://arxiv.org/abs/2103.10360 https://arxiv.org/abs/2103.10360 quite easy to build