3 ms·
How can you finetune for a new language? Aren't the tokens baked in by the time the model is done training?
by 1024core 3y ago
How can you finetune for a new language? Aren't the tokens baked in by the time the model is done training?
- brucethemoose2 3y agoApparently not. shrug The backend does sometimes need a new tokenizer, depending on how its implemented.