3 ms·Yup, and the state of the art BERT and gpt-2 are both based on transformers.by return1 7y agoYup, and the state of the art BERT and gpt-2 are both based on transformers.