At this stage the worry is more about the conscious beings interacting with these things. LLMs themselves are just inert programs at present, but the entire sys

At this stage the worry is more about the conscious beings interacting with these things. LLMs themselves are just inert programs at present, but the entire system end-to-end comprises of the algorithms, the hardware and end users. With all of that taken together, there's a whole lot of consciousness in the system in aggregate that appears to be motivated and/or incentivised to increase the capabilities of the algorithms and hardware, so the fact that LLMs themselves aren't conscious is sort of besides the point in my opinion. The cat is already out of the bag.