3 ms·
Facebook/Meta has been doing open research in ML and NLP for far longer than the current LLM era: Convolutional Neural Networks for Sentence Classification (201
by gillesjacobs 2y ago
Facebook/Meta has been doing open research in ML and NLP for far longer than the current LLM era: Convolutional Neural Networks for Sentence Classification (2014), FastText (2016), PyTorch (2016), fairseq (2017), LASER (2018), RoBERTa (2019), XLM-R (2019), and BART (2019),
They were always present at ACL with decent open research as far as I have been studying/working in NLP (2014).
It's part of a strategy to attract top talent in the field. If you want top researchers you have to let them publish, which in turn hones a reputation of solid research, attracting more talent.
- behnamoh 2y ago> It's part of a strategy to attract top talent in the field. If you want top researchers you have to let them publish, which in turn hones a reputation of solid research, attracting more talent. This. Although, it turns out, if you pay them well enough (like OpenAI), they'll forego publishing. If you can make enough to retire by 40, why work at places that pay less? ofc, not all researchers think that way, and there are those who are in it for the science, not just money.