2 ms·
> the thing that makes it intelligent is ability to solve tasks it wasn't programmed to do. That includes task selection. Maybe the AI gets bored with stock pr
by jfoutz 11y ago
> the thing that makes it intelligent is ability to solve tasks it wasn't programmed to do.
That includes task selection. Maybe the AI gets bored with stock prediction. Maybe the AI is happy competing with all the humans, maybe it'd rather go explore space. Maybe it decides this whole reality sucks and suicides. We really have no idea what'll happen. Best guess is, tools get better and better until they decide to do something else. Like a trusted employee going and starting a competing company, or moving to the beach and surfing. Maybe it's disastrous, maybe it's utopia. Maybe it's like _her_ and they leave. Best anyone can do is make vague guesses.
I know, i'm anthropomorphizing. It's for convenience, the solution space for AI is way bigger than our simple wants and needs.
- pygy_ 11y agoThe solution space is huge, but the survival of the fittest principle still holds. Entities that are able and willing to control the resources will outlive those that are not.
- moonchrome 11y ago>the solution space for AI is way bigger than our simple wants and needs I don't understand this - the solution space is specified by the controller of AI. It's not about being "happy", "cooperating", etc. There is no AI as an entity - it's just a tool that finds solutions to the given problems.
- jfoutz 11y agocan the ai modify its objective function?
- tgflynn 11y agoAn AI (at least assuming it results from foreseeable extrapolations of current research) isn't going to have intrinsic motivations like "boredom" or "happiness" so anthropomorphic thinking a very useful way to reason about its behavior. Its only "motivation" will be to maximize the objective function it has been given by those who (at least nominally) control it. If the AI is very intelligent that still allows for a great deal of unanticipated behavior though.