3 ms·That was a much smaller model, couldn't do much more than crawl around and run away.by namaria 2y agoThat was a much smaller model, couldn't do much more than crawl around and run away.thfuran 2y agoIt was still used as part of pretraining the current model.namaria 2y agoNonsense, the current model is a new architectural approach. It was all explained in that recent paper, "Attention is all your meat"