> Error: Violation of the Church-Turing thesis detected. Many tasks completability is not known until we attempt to complete the task. Yes, but for some tasks

> Error: Violation of the Church-Turing thesis detected. Many tasks completability is not known until we attempt to complete the task. Yes, but for some tasks we know that they are impossible. I do agree that this is quite a fragile and unreliable workaround. It may only serve as a bit of a stopgap until we come up with something better. > Models that can't accomplish things don't survive. So that alone isn't a workable theory. It's not what I said. I didn't advocate for agents that don't achieve any task. Reread what I suggested. > So it's likely we can push models in being more moral That does not follow from what you said. We know that the current models prefer task completion over moral behavior. That's the entire point here. > But even that runs into the issue of "what if some crazy bastard (or AI) designs a new model purposefully unhinged". How are you dealing with that bullshit in the wild? This is irrelevant to the discussion (although I do agree that there is no reliable defense against malevolent actors creating powerful malevolent AI).