4 ms·
"Bad intentions" aren't even necessary -- out of control AGI will probably look more like "oops, I hit >rm -rf /". AFAIK, nearly every piece of software ever d
by leot 11y ago
"Bad intentions" aren't even necessary -- out of control AGI will probably look more like "oops, I hit >rm -rf /".
AFAIK, nearly every piece of software ever deployed has had bugs that humans have had to subsequently patch. AGI must not, even though it would probably be much easier to build it if it did.
- TeMPOraL 11y ago> AGI must not, even though it would probably be much easier to build it if it did. Which is exactly what raises the issue to the level of an existential threat - it's easier to build an Unfriendly AGI than a Friendly one - which means the first GAI ever built is likely to be Unfriendly - and it takes only one impatient team / person unleashing an UGAI on the world to kill us all.