3 ms·
Length of given text after encoding it with their BPE. In general, you can expect it to be 1.2x-2x the len(words) in your text.
by winchester6788 6y ago
Length of given text after encoding it with their BPE. In general, you can expect it to be 1.2x-2x the len(words) in your text.