3 ms·

This does not mean much for non encoder-decoder versions. GPT and the like are decoder only and wouldn't fall under this patent. You can look at their supplied

This does not mean much for non encoder-decoder versions. GPT and the like are decoder only and wouldn't fall under this patent. You can look at their supplied diagrams and general summary to confirm.

ttul 3y ago
Yes, but patent US11556786B2 claims the decoder-only transformer.
- ianbutler 3y ago
  Drats!