3 ms·Transformers (the frontend in GPT at least) are autoregressive i.e. they require previous state.by KRAKRISMOTT 4y agoTransformers (the frontend in GPT at least) are autoregressive i.e. they require previous state.