2 ms·
i flipped the results, my bad. > Note, however, that the results in random span infilling are significantly worse in suffix-prefix-middle (SPM) format than in
by swyx 3y ago
i flipped the results, my bad.
> Note, however, that the results in
random span infilling are significantly worse in suffix-prefix-middle (SPM) format than in prefix-suffix-middle
(PSM) format as it would require token healing (Microsoft, 2023),
- huac 3y agoyeah, I hear you that the decoder-only infilling approach is 'weird' -- I just don't know if I agree that it's manifestly worse at language understanding / performance than the BERT appraoch