Relative to today's models, it is small. For the time, it was large. Re: that it's not auto regressive, that's correct. Things built on eachother smoothly. T

Relative to today's models, it is small. For the time, it was large. Re: that it's not auto regressive, that's correct. Things built on eachother smoothly. Transformers to BERT to GPT.