3 ms·
> Yud and his entire project failed to predict literally anything about how LLMs work. In their defense, LLMs did come a bit out of the blue. In retrospect, Yu
by TeMPOraL 4y ago
> Yud and his entire project failed to predict literally anything about how LLMs work.
In their defense, LLMs did come a bit out of the blue. In retrospect, Yudkowsky and his disciples were focusing too much on rationality as science/mathematics, bending Bayes to the point of breaking to try and gleam how perfect intelligence works, and how to somehow formalize the aggregate mess of our fuzzy morality.
They failed to predict that shoving gigabytes of random Internet text at a NN, and having it place parts of words as points in a hundred thousand dimension vector space, will suddenly reduce most of what we consider "thinking" into proximity search in said vector space. They were so focused on the theory, they failed to predict the brute-force, messy practice. But so did everyone else.
If anything, Yudkowsky & co. were the only people consistently taking the problem seriously, and got the outline right.