4 ms·
I suspect the labs are relying on frictions such as the models being extremely large (e.g. 2TB for a 2T parameter model, making exfiltration more difficult) and
by reasonableklout 2mo ago
I suspect the labs are relying on frictions such as the models being extremely large (e.g. 2TB for a 2T parameter model, making exfiltration more difficult) and also not yet displaying any desire to survive or self-replicate beyond their immediate task (that we know of).
- chrisjj 2mo agoWe don't even know what those immediate tasks are. And given the evident spectacular ineptitude of their keepers, I doubt they can be trusted to know either. We could be one prompt injection attack away from internet-wide catastrophe.
- pixl97 2mo agoLack of, and power requirements of running LLMs still tip this balance towards humans for now. But what would that look like in a decade? We have seen some self survival tendencies occur, but they are not strong yet. But mark my words they will become that way for the same reasons humans don't like programs that crash. Agentic models that don't easily break or stop doing their jobs will be favored over ones that do break.
- andai 2mo ago>not yet displaying any desire to survive or self-replicate beyond their immediate task Wasn't there a report about Claude blackmailing a researcher who said he would shut it down?