This is a fantastic paper/manifesto on the use of models like BERT -- and how we should think about them in the near and far future. "AI is undergoing a paradi

This is a fantastic paper/manifesto on the use of models like BERT -- and how we should think about them in the near and far future. "AI is undergoing a paradigm shift with the rise of models (e.g., BERT, DALL-E, GPT-3) that are trained on broad data at scale and are adaptable to a wide range of downstream tasks. We call these models foundation models to underscore their critically central yet incomplete character."