I don't think LLMs are AGI and I'm not sure if it's an architecture that leads to AGI. But "performing exactly how they were designed to" seems wrong in at leas

I don't think LLMs are AGI and I'm not sure if it's an architecture that leads to AGI. But "performing exactly how they were designed to" seems wrong in at least two ways: (1) their creators have done tons of RLHF to try to prevent them from saying things that are false, or racist/sexist, or likely to create danger, but it's pretty easy to get them to do that anyway; (2) lots of specific predictions about LLM capabilities are proven false each time a new one comes out, e.g. being able to pass college-level exams in many subjects. These kinds of behaviors were not designed, they are emergent. You could call this "as designed" in the vacuous sense that the design contains these possibilities even if not anticipated. But then "performing as designed" is not the same as "controlled". Similar levels of unexpected behavior in coordinating weapons would be very very bad.