4 ms·

Checkout the confidence level of alignment in the below excerpt. "probably". Will this be the standard for future deployments? "Finally, we facilitated a preli

Checkout the confidence level of alignment in the below excerpt. "probably". Will this be the standard for future deployments? "Finally, we facilitated a preliminary model evaluation by the Alignment Research Center (ARC) focused on the ability of GPT-4 versions they evaluated to carry out actions to autonomously replicate and gather resources —a risk that, while speculative, may become possible with sufficiently advanced AI systems— with the conclusion that the current model is probably not yet capable of autonomously doing so."

ChatGTP 4y ago
"Finally, we facilitated a preliminary model evaluation by the Alignment Research Center (ARC) focused on the ability of GPT-4 versions they evaluated to carry out actions to autonomously replicate and gather resources —a risk that, while speculative, may become possible with sufficiently advanced AI systems— with the conclusion that the current model is probably not yet capable of autonomously doing so." Is this a joke? If this is even slightly considered possible, I think more conversations are needed to allow this to continue. Maybe best to be continuing this research on a self-contained space station or something?
- 13years 4y ago
  No joke, from page 3 of the pdf. I'm stunned at the lack of rigorous process around alignment that this suggests. Furthermore, in my own contemplations I don't even perceive how alignment could ever be possible as from my perception we have built the very premise on top of an unsolvable paradox. I elaborate on that in great detail in my recent writings here FYI - https://dakara.substack.com/p/ai-singularity-the-hubris-trap https://dakara.substack.com/p/ai-singularity-the-hubris-trap
- obscur 4y ago
  While I agree it is worth noting that this was already tested in some kind of sandbox environment that only ‘simulated’ replication.

ChatGTP 4y ago

"Finally, we facilitated a preliminary model evaluation by the Alignment Research Center (ARC) focused on the ability of GPT-4 versions they evaluated to carry out actions to autonomously replicate and gather resources —a risk that, while speculative, may become possible with sufficiently advanced AI systems— with the conclusion that the current model is probably not yet capable of autonomously doing so." Is this a joke? If this is even slightly considered possible, I think more conversations are needed to allow this to continue. Maybe best to be continuing this research on a self-contained space station or something?

13years 4y ago
No joke, from page 3 of the pdf. I'm stunned at the lack of rigorous process around alignment that this suggests. Furthermore, in my own contemplations I don't even perceive how alignment could ever be possible as from my perception we have built the very premise on top of an unsolvable paradox. I elaborate on that in great detail in my recent writings here FYI - https://dakara.substack.com/p/ai-singularity-the-hubris-trap https://dakara.substack.com/p/ai-singularity-the-hubris-trap
obscur 4y ago
While I agree it is worth noting that this was already tested in some kind of sandbox environment that only ‘simulated’ replication.