3 ms·
> In Progress: CodonJEPA JEPA is going to break the whole industry :D
by khalic 7mo ago
> In Progress: CodonJEPA
JEPA is going to break the whole industry :D
- digdugdirk 7mo agoCan you explain this? I haven't heard of JEPA, and from a quick search it seems to be vision/robotics based?
- lukeinator42 7mo agohttps://openreview.net/pdf?id=BZ5a1r-kVsf https://openreview.net/pdf?id=BZ5a1r-kVsf
- khalic 7mo agoIt’s a self supervised learning architecture, and it’s pretty much universal. The loss function runs on embeddings, and some other smart architectural choices allover. Worth diving into for a few hours, Yann LeCun gives some interesting talks about it