2 ms·
Don't you know that "attention is all you need"? Attention is non-markovian. It's all-to-all with some masking, not a chain.
by visarga 3y ago
Don't you know that "attention is all you need"? Attention is non-markovian. It's all-to-all with some masking, not a chain.