3 ms·You can still pretrain on synthetic data and finetune on a smaller dataset of real data.by visarga 7y agoYou can still pretrain on synthetic data and finetune on a smaller dataset of real data.