You are right that this class of problems has the advantage of cheaply getting a lot of training data. Another type of model with the advantage of cheap traini

You are right that this class of problems has the advantage of cheaply getting a lot of training data. Another type of model with the advantage of cheap training data is BERT like models for natural language processing where input training data is just natural language text with random words replaced by ‘holes’ and target output is the original text with no missing words.