3 ms·

> we might hope that superhumanly-intelligent AIs will agree. this kind of fear of misalignment bamboozles me - is there any proposed AI architecture that is n

• concordDance 4y ago
  Yes there are, ones that put language models in action loops (where the output is sent to a command line or something and the response sent back to the model as extension of the prompt). That said, they definitely aren't going to be fooming this year!
• dragonwriter 4y ago
  > this kind of fear of misalignment bamboozles me - is there any proposed AI architecture that is not merely call and response? Yes, models that interact with the physical world or other external real-time systems would (even if the underlying model is “call-and-response” in a sense) be called in an infinite loop (possibly with exit conditions) by with captured input (sensor, command if available, potentially also past output) data. Heck, the ReAct architecture which is used to provide extension (retrieval, web lookup, interface to other systems) for chat-style agents gives them an action loop without human-in-the-loop (usually, this is explicitly limited and is designed to do a finite number of actions in the course of getting to a response) but could be unlimited, or could even when limited connect to actions that involve reprompting (immediate or delayed) without a human in the loop.