2 ms·
It's clear, although I think the "recipes for ruin" focuses too narrowly on the lower bound for ways to destroy the world, like a bright teenager with $10,000.
by mitthrowaway2 3y ago
It's clear, although I think the "recipes for ruin" focuses too narrowly on the lower bound for ways to destroy the world, like a bright teenager with $10,000. Another important framing is "what degree of economic resources might an AI be entrusted to manage, in the future, and are there any recipes for ruin that fall within that range". For example, if an ASI is put in charge of managing an investment fund with $10 billion in assets, would it be capable of building a doomsday device (and disguising it as a productive investment)?