4 ms·
GPT-3 (and other Transformers-based models) do a surprisingly-good job at maintaining entity relationships over a long horizon, thanks to attention mechanisms.
by minimaxir 6y ago
GPT-3 (and other Transformers-based models) do a surprisingly-good job at maintaining entity relationships over a long horizon, thanks to attention mechanisms.