2 ms·
> What if you combine those with an LLM that has been prompted to take over every machine on the planet? Or, without a melodramatically villainous human action
by dragonwriter 4y ago
> What if you combine those with an LLM that has been prompted to take over every machine on the planet?
Or, without a melodramatically villainous human action in the mix, one which has been prompted to perform some innocuous task, but given inadequate safeguards, and for which it reasons (perhaps accurately, with the paramters it has been given) taking over every other computer will be useful in more efficiently carrying out.
- ifyoubuildit 4y agoRight, good point, the innocuous case is probably most likely. Either way, once it happens, incredible amounts of damage would be done very quickly.
- yeck 4y agoAccidents are a big risk, but don't underestimate the number of individuals and small groups that have fundamentally anti-social philosophies. I think of groups like antinatalists, doomsday religious groups, traditional terrorist orgs. There is even a sort of post-human futurist that sees humanity's purpose being to create a great super intelligence to replace us (may be overlap with this group and antinatalists). So, I think there we be more chances for legit accidents, but also some motivated people intentionally trying to cause harm.