5 ms·
I am wondering about the differences with CamemBERT which is another BERT for the french language: https://camembert-model.fr/#about https://camembert-model.fr/
by nestorD 6y ago
I am wondering about the differences with CamemBERT which is another BERT for the french language: https://camembert-model.fr/#about https://camembert-model.fr/#about
- Qiu_Zhanxuan 6y agoI might be wrong but i think they are trained on different tasks
- byteface 6y agoFlaubert's Parrot
- Aissen 6y agoExcerpt from the paper conclusion: > FlauBERT is competitive with CamemBERT (Martin et al., 2019) – another pre-trained language model for French – despite being trained on almost twice as fewer text data.
- nl 6y ago> being trained on almost twice as fewer text data Clearly they didn't run that through the English BERT because no language model would assign high probability to that phrase!