3 ms·
I think that's anthropomorphisation. We can look at the reward functions to guess what, for lack of a better word, "feels good" to an AI (even without qualia,
by ben_w 3y ago
I think that's anthropomorphisation.
We can look at the reward functions to guess what, for lack of a better word, "feels good" to an AI (even without qualia, the impact on the outside world is likely similar), but we can only use this to learn about the gradient, not the absolute value: when we thumbs-down a ChatGPT response, is that more like torture, or more like the absence of anticipated praise? When it's a reply along the lines of "JUST DO WHAT I SAY!1!!11!", is the AI's learning process more like constructing a homunculus to feel the sting of rejection in order to better mimic human responses, or is the AI more like an actor playing a role? Or is it still below some threshold we can't yet even recognise, such that it is, as critics say, just a fancy chatbot?
Also, "superintelligence" is poorly defined: by speed, silicon had us beat probably before the first single-chip CPU[0]; by how much they could remember, hard drives probably some time early this century; as measured by "high IQ" games like chess and Go, their respective famous games in 1997 and 2016; by synthesis of new answers from unstructured reading, about 2 years ago if you take InstructGPT as the landmark; but what we have now has to take all of those advantages to get something that looks like a distracted intern in every subject.
[0] And the only reason I'm stopping there is that I don't want to nerd-snipe myself with greater precision