3 ms·
I can’t see where in the paper Data2Vec is reported to have contextual embeddings that work across modalities. Can you reference the section in the paper?
by notsoprocoder 4y ago
I can’t see where in the paper Data2Vec is reported to have contextual embeddings that work across modalities. Can you reference the section in the paper?
- m00x 4y agoDifferent models for now, but it's essentially doing this through the teacher model. If you go down to the numbers, it's very similar. They're saying they want to do this later. Gato does this in the same embeddings IIRC, but I skimmed the paper so I could be wrong.
- notsoprocoder 4y agoThanks! I should probably read the gato paper. If only there were enough hours in the day.