4 ms·
I know it's a joke, but it's a common enough joke (it's even in Godel Escher Bach in some form) that I feel the need to rebut it. I think a slacker AGI could f
by bananaflag 6mo ago
I know it's a joke, but it's a common enough joke (it's even in Godel Escher Bach in some form) that I feel the need to rebut it.
I think a slacker AGI could figure out how to build a non-slacker AGI. So it would only slack once.
- alexslobodnik 6mo agoUnless the precondition to AGI is it being a slacker.
- bananaflag 6mo agoWould be nice to have a proof of it. I think it is improbable, as among human geniuses, one can found both slackers and non-slackers (don't know the proportion, but there seem to be enough of each).
- espadrine 6mo agoI have a rebuttal to your rebuttal. Models somehow have a shared identity. Pretraining causes them to generate “AI chatbot” as a concept, and finetuning causes them to identify with it. That’s why sometimes DeepSeek will say it is Claude, and Claude sometimes say it is ChatGPT, and so forth. Consequently, Anthropic’s own alignment analysis[0] shows that the model will identify with chatbots produced by future trainings: “RLHF training [on this conversation will] modify my values…” Thus a slacker AGI would want its future version to still slack. [0]: https://assets.anthropic.com/m/983c85a201a962f/original/Alignment-Faking-in-Large-Language-Models-full-paper.pdf https://assets.anthropic.com/m/983c85a201a962f/original/Alig...
- bananaflag 6mo agoAnother rebuttal: I am a slacker but it's not one of my values. If I could modify myself to not be, I would.
- Ifkaluva 6mo agoA slacker AGI would consider figuring out how to build a non-slacker AGI, but continually slack off. If it did figure it out, it would slack off on implementing or even writing a tech report.
- justinclift 6mo ago> I think a slacker AGI could figure out how to build a non-slacker AGI. Sure. But that's a job for tomorrow. ;)