3 ms·
The meta-question: Does the commentary in GPT-3's output apply to the output itself?
by segfaultbuserr 6y ago
The meta-question: Does the commentary in GPT-3's output apply to the output itself?
- visarga 6y agoYes, transformers allow attention to flow to all previous tokens, even while the phrase is being generated.