Big pretrained models are a huge contributing factor. Being able to take a model that already mostly knows language and a model that already mostly knows images

Big pretrained models are a huge contributing factor. Being able to take a model that already mostly knows language and a model that already mostly knows images and hook them up means you don’t need to do the entire end to end learning together.