5 ms·
FlauBERT and Flue: French Bert
- nestorD 6y agoI am wondering about the differences with CamemBERT which is another BERT for the french language: https://camembert-model.fr/#about https://camembert-model.fr/#about
- Qiu_Zhanxuan 6y agoI might be wrong but i think they are trained on different tasks
- byteface 6y agoFlaubert's Parrot
- Aissen 6y agoExcerpt from the paper conclusion: > FlauBERT is competitive with CamemBERT (Martin et al., 2019) – another pre-trained language model for French – despite being trained on almost twice as fewer text data.
- nl 6y ago> being trained on almost twice as fewer text data Clearly they didn't run that through the English BERT because no language model would assign high probability to that phrase!
- maeln 6y agoContext for the name: Gustave Flaubert is a classic French author, https://en.wikipedia.org/wiki/Gustave_Flaubert https://en.wikipedia.org/wiki/Gustave_Flaubert
- jcmeyrignac 6y agoHere is their paper: https://arxiv.org/pdf/1912.05372 https://arxiv.org/pdf/1912.05372
- aerodog 6y agoDo the French pronounce this as "Flau-Bear"?
- seszett 6y agoFlo-bear, yes.
- person_of_color 6y agoNow do Sanskrit
- woodson 6y agohttps://parmarsuraj99.github.io/suraj-parmar/jupyter/nlp/huggingface/2020/05/02/SanskritALBERT.html https://parmarsuraj99.github.io/suraj-parmar/jupyter/nlp/hug...