7 ms·
On the Opportunities and Risks of Foundation Models
- cl42 5y agoThis is a fantastic paper/manifesto on the use of models like BERT -- and how we should think about them in the near and far future. "AI is undergoing a paradigm shift with the rise of models (e.g., BERT, DALL-E, GPT-3) that are trained on broad data at scale and are adaptable to a wide range of downstream tasks. We call these models foundation models to underscore their critically central yet incomplete character."