4 ms·
What's the relationship with the Platonic Representation Hypothesis?
by canjobear 11mo ago
What's the relationship with the Platonic Representation Hypothesis?
- MarkusQ 11mo agoFrom what I can tell, they are very closely related (i.e. the shared representational structures would likely make good candidates for Platonic representations, or rather, representations of Platonic categories). In any case, it seems like there should be some sort of interesting mapping between the two.
- brillcleaner 11mo agoMy first thought was that this was somehow distilling universal knowledge. Platonic ideals. Truth. Beauty. Then I realized- this was basically just saying that given some “common sense”, the learning essence of a model is the most important piece, and a lot of learned data is garbage and doesn’t help with many tasks. That’s not some ultimate truth, that’s just optimization. It’s still a faulty LLM, just more efficient for some tasks.
- unionjack22 11mo agoI hope someone much smarter than I answers this. I’ve been noticing an uptick platonic and neo-platonic discourse in the zeitgeist and am wondering if we’re converging on something profound.
- deleted 11mo ago[deleted]
- nowittyusername 11mo agoI've been noticing that as well....
- altairprime 11mo agoSame hat, except 18 months later, assuming it survives peer review, reproduction, etc. (or: "The newer one proposes evidence that appears to support the older one.") https://arxiv.org/abs/2405.07987 https://arxiv.org/abs/2405.07987