Validation is different from supervision. Supervision happens during training. Typically when we train speech model, we prepare a speech segment and its transcr

Validation is different from supervision. Supervision happens during training. Typically when we train speech model, we prepare a speech segment and its transcript, this transcript is generated manually by human. For language models such as BERT or GPT-3, you don't really need human generated labels, what it does is to mask out some text, and the masked out text is the label to be predicted (self-supervise), the label is already in the data. What this model does is to universally train on images, text and speech this way, and when you combine these data, they will be complementary to each other. Think what you can do with a language model like GPT-3 now, you would be able to ask the model to do something with text, speech and images. The only thing I would worry about this model is that I would imagine Facebook trained on lots of data, and the model may be used to extract sensitive data maybe. The multi-modal part is a big deal because we could have a model be able to understand all inputs human needs.