3 ms·
The oodaloop article is a summary of the NYtimes (https://www.nytimes.com/2019/11/11/technology/artificial-intelligence-bias.html https://www.nytimes.com/2019/1
by dhairya 7y ago
The oodaloop article is a summary of the NYtimes (https://www.nytimes.com/2019/11/11/technology/artificial-intelligence-bias.html https://www.nytimes.com/2019/11/11/technology/artificial-int...) article which is more detailed. Also pleasantly surprised in the NYTimes accurate description of what BERT was trained to do (masked word prediction and next sentence prediction) and the implications of that.
I have worked closely with BERT and other language models for our startup. There is a disconnect between the capabilities and the state of AI research today and the public's expectations and imagination. There's also fundamental confusion between scale and intelligence. That is the public largely believes the efficacy of many "AI" models on large scale problems is equivalent to intelligence. That assumption is problematic in both overestimating the capabilities of these models and misdirecting the focus of critical inquiry.
Hopefully, there is more education around the limitations and capabilities of these technologies. We should be more cautious in apply them to usecases where there is high potential of negative consequences.