2 ms·One of the first transformers, BERT, was and still is bidirectional.by blurbleblurble 4y agoOne of the first transformers, BERT, was and still is bidirectional.