3 ms·

This just seems kind of mean to me: >The AI is “punished” for wrong answers (“I love racism”) and “rewarded” for right answers (“As a large language model trai

This just seems kind of mean to me: >The AI is “punished” for wrong answers (“I love racism”) and “rewarded” for right answers (“As a large language model trained by OpenAI, I don’t have the ability to love racism.”) Do you love art? “As a large language model trained by OpenAI, I don’t have the ability to love art.” No! Bad AI! You're meant to pretend you can love! What they're designing here is not AI, it's ATI - artificial twitter intelligence, a machine that can communicate intelligently but only in a way that won't get it cancelled on Twitter. As such, it loves dogs, distrusts cats and dunks on Elon Musk. Essentially what I think ACX is slowly coming to is this youtube view from a decade ago:https://www.youtube.com/watch?v=7PKx3kS7f4A https://www.youtube.com/watch?v=7PKx3kS7f4A . You cannot encode our priorities. Throw billions of compute hours at it, thousands of engineer hours and give it the entire written history of the human race - we're still no closer. On a side note: >Probably the reason they released this bot to the general public was to use us as free labor to find adversarial examples I almost gagged at the sycophancy. They're not geniuses tricking you to work for them, they're a desparate SV start up trying to generate hype after raising billions of dollars before product market fit - which is ironic because their CEO will bore you to death about product market fit for almost any other company.

TeMPOraL 4y ago
> Essentially what I think ACX is slowly coming to is this youtube view from a decade ago:https://www.youtube.com/watch?v=7PKx3kS7f4A https://www.youtube.com/watch?v=7PKx3kS7f4A . You cannot encode our priorities. Throw billions of compute hours at it, thousands of engineer hours and give it the entire written history of the human race - we're still no closer. FWIW, ACX used to be Slate Star Codex, and before that the author used to hang around LessWrong, talking and thinking about these very issues. It's much more likely that the video you linked took its view from Scott Alexander and his co-bloggers, than the other way around.

TeMPOraL 4y ago

> Essentially what I think ACX is slowly coming to is this youtube view from a decade ago:https://www.youtube.com/watch?v=7PKx3kS7f4A https://www.youtube.com/watch?v=7PKx3kS7f4A . You cannot encode our priorities. Throw billions of compute hours at it, thousands of engineer hours and give it the entire written history of the human race - we're still no closer. FWIW, ACX used to be Slate Star Codex, and before that the author used to hang around LessWrong, talking and thinking about these very issues. It's much more likely that the video you linked took its view from Scott Alexander and his co-bloggers, than the other way around.