4 ms·
Not sure what's so controversial, it's well known that LLMs can trivially be viewed as operating in higher dimensional space: https://gcptips.medium.com/a-geom
by naasking 2y ago
Not sure what's so controversial, it's well known that LLMs can trivially be viewed as operating in higher dimensional space:
https://gcptips.medium.com/a-geometric-perspective-on-large-language-models-23ec7e91c764 https://gcptips.medium.com/a-geometric-perspective-on-large-...
As for generalizing to algorithms, LLMs don't yet do this as well as humans, but they do do it:
https://arxiv.org/abs/2309.02390 https://arxiv.org/abs/2309.02390
Finally, there's no intrinsic reason why an AI that can reliably solve deductive problems like ARC would be limited to two dimensions.
- benchmarkist 2y agoThen you have no reason to argue with me.
- naasking 2y agoThe only position I took issue with, and still do, is my closing paragraph of my last post. Your argument for why ARC solvers wouldn't generalize doesn't even make sense.
- benchmarkist 2y agoNo point in arguing. If you think it will generalize then there is no reason to convince random people on the internet that ARC-AGI solver will get you closer to AGI.