37 ms·
I believe that multimodal training increases the robustness of latent representations regardless of which modality is being processed.
by Llamamoe 1mo ago
I believe that multimodal training increases the robustness of latent representations regardless of which modality is being processed.
- nateb2022 1mo agoTangentially this makes me wonder how large Opus really is. Perhaps Opus is a lot smaller than most of the 1T+ assumptions, just a lot more post-training/ finetuning on a 300-400B sized MoE model.