3 ms·
This is true, but likewise something has the potential to be civilization ending without necessarily being conscious (by whatever definition you like).
by mythrwy 4y ago
This is true, but likewise something has the potential to be civilization ending without necessarily being conscious (by whatever definition you like).
- jononor 4y agoYes a virus that is very deadly, or one that renders the persons infertile, could be one. Or a bacteria that take everything of a critical resource, like oxygen of the atmosphere. But my argument for safety here is that Bing bot is severely lacking in agency. It has no physical reach. It has limited ability to perform external IO (it can maybe make GET requests). It can, as far as I know, not do arbitrary code execution. It runs in MS data centers, and cannot easily itself replicate elsewhere (certainly not while keeping its communication reach on bing.com). It's main mechanism for harm is the responses that people read, so the main threat is it tricking people. Which is challenging to scale, it would either have to trick some very powerful people, or a large portion of the population to have any chance at civilisations endring things. If it does become both conscious and "evil", we have very good chances of it not being able to execute much on that, and very good chances of shutting it down.