3 ms·
> transformers are "permutation invariant" by nature Surely that does not apply to GPT models which use causal masking.
by lostmsu 3y ago
> transformers are "permutation invariant" by nature
Surely that does not apply to GPT models which use causal masking.