3 ms·
JEPA is presumably superior to Transformers. Can any expert enlighten us on the implications of this paper?
by justanotheratom 2y ago
JEPA is presumably superior to Transformers. Can any expert enlighten us on the implications of this paper?
- spmurrayzzz 2y agoTransformers are usually part of JEPA architectures. In I-JEPA's case, there is a ViT that is used in the context encoding phase.