3 ms·
If they use BPE dropout, then the split can be different and not unique. And for the record, they use BPE dropout for DALLE-1, see https://arxiv.org/pdf/2102.1
by karmasimida 4y ago
If they use BPE dropout, then the split can be different and not unique.
And for the record, they use BPE dropout for DALLE-1, see https://arxiv.org/pdf/2102.12092.pdf https://arxiv.org/pdf/2102.12092.pdf
- DalasNoin 4y agoI believe they only apply it during training.
- karmasimida 4y agoright, that is my point. It is hard to know which combination triggers the current tokenization to be interpreted as bird.