Deeply familiar with BERT. It lacks the very ability he is describing, to adapt itself, get up to speed, and collect relevant information in a new field, becaus

Deeply familiar with BERT. It lacks the very ability he is describing, to adapt itself, get up to speed, and collect relevant information in a new field, because that's simply not how it works. It can't possibly explain itself because it lacks any mechanism of introspection that could possibly give it that ability. It's an expensive way of gaining a very accurate language model that can be tweaked and get good results on a lot of tasks, but it doesn't understand what it's doing. It can't argue for its position or explain why it thinks whatever it thinks. It's not operating on that level of reasoning, at all. An artist understands the goals of construction work, and can pick up the skills necessary along the way, because we can understand a goal and have a wide variety of cognitive tools to let us know how we are doing. If you've worked closely with BERT you already know that interns have nothing to worry about, not just from the current crop of tools that includes BERT, but from the entire line of deep learning research, short of a sudden and dramatic shift in direction.