3 ms·It's also smaller than GPT-2 (1.2B vs 1.6B) and trained with a lot less language data (6% of the training mix).by CRG 4y agoIt's also smaller than GPT-2 (1.2B vs 1.6B) and trained with a lot less language data (6% of the training mix).