This seems reasonable. The core mechanism is a “transformer” https://jalammar.github.io/illustrated-gpt2/ https://jalammar.github.io/illustrated-gpt2/ GPT3 is

This seems reasonable. The core mechanism is a “transformer” https://jalammar.github.io/illustrated-gpt2/ https://jalammar.github.io/illustrated-gpt2/ GPT3 is essentially GPT2 with more training data.