3 ms·
Please at least read the paper before appealing to authority. It is a well designed set of experiments that clearly demonstrates that the notion of a "phase cha
by nsagent 3y ago
Please at least read the paper before appealing to authority. It is a well designed set of experiments that clearly demonstrates that the notion of a "phase change" (rapid shift in capabilities) as a popularized by many people claiming emergence is actually a gradual improvement with more data.
But if you do want to appeal to Lecun as an authority, then maybe you'll accept that these (re)tweets that clearly indicate he finds the insights from the paper to be valid:
https://nitter.1d4.us/ylecun/status/1736479356917063847 https://nitter.1d4.us/ylecun/status/1736479356917063847
https://nitter.1d4.us/rao2z/status/1736464000836309259 https://nitter.1d4.us/rao2z/status/1736464000836309259 (retweeted)
As for Timnit, I think you have your timeline confused. Model cards are what put her on the map for most general NLP researchers, which predates her difficulties at Google.
2018: Model cards paper was put on arXiv https://arxiv.org/abs/1810.03993 https://arxiv.org/abs/1810.03993
2019: Major ML organizations start using model cards https://github.com/openai/gpt-2/blob/master/model_card.md https://github.com/openai/gpt-2/blob/master/model_card.md
2020: Model cards become fairly standard https://blog.research.google/2020/07/introducing-model-card-toolkit-for.html https://blog.research.google/2020/07/introducing-model-card-...
Dec 2020: Timnit is let go from the ethics team at Google https://www.bbc.com/news/technology-55187611 https://www.bbc.com/news/technology-55187611
EDIT:formatting