3 ms·

The attention mechanisms present in transformers don’t seem easy to map to semantics that humans can understand. There are too many parameters involved