Different models for now, but it's essentially doing this through the teacher model. If you go down to the numbers, it's very similar. They're saying they want

Different models for now, but it's essentially doing this through the teacher model. If you go down to the numbers, it's very similar. They're saying they want to do this later. Gato does this in the same embeddings IIRC, but I skimmed the paper so I could be wrong.