3 ms·

> Unaligned intelligence is dangerous. You don't need a Sci-fi book to realize this, just a history one. > Our history is replete with examples of the slightly

• famouswaffles 3y ago
  Any Unaligned intelligence is dangerous. People get murdered because the perpetrator's desire to kill is unaligned with the victim's desire to live. The only thing that changes is the scope of danger. Look at how we're giving LLMs more and more agency, embodiment and tool control. They're being "plugged" into everything. Palantir even has a military use LLM they're excitedly showcasing. They're several popular repos that give control of your terminal and browser to LLMs. The moment we built something showcasing strong general intelligence, we began to use it to make cognitive decisions and take actions in our stead. Now an LLM browses the web for you. And as soon as June with Windows, it'll take actions on your computer for you as well. If anything this recent LLM era has shown, it's that general AI won't need to escape any "box" because two sides will be missing. No point saying "well a person can't kill thousands on his/her own so an ai won't be able to" when you have the ai influencing military tactics on a global scale. General Super Intelligence will evidently not be as blacked boxed as any one human and that's not even taking into account whatever advantage super intelligence will bring.