2 ms·Worthy to note that as another comment mentioned, GPT3 was likely trained on pre-GPT2 data.by O_H_E 6y agoWorthy to note that as another comment mentioned, GPT3 was likely trained on pre-GPT2 data.