> Like, one can theorize about some novel, distinct system that is able to interact with the external world There are plenty of these already. By the time the

> Like, one can theorize about some novel, distinct system that is able to interact with the external world There are plenty of these already. By the time they "go evil", it may be too late. But the word evil is probably overly anthropomorphized. The first times it happens, it might be a mechanical result of optimizing for some other metric.