3 ms·
Well, every character of the string can be a token. From a transformer's perspective it shouldn't matter if it is Chinese, English or "chess" language.
by lewhoo 3y ago
Well, every character of the string can be a token. From a transformer's perspective it shouldn't matter if it is Chinese, English or "chess" language.