I see instincts as something like a pre-installed ROM. It shouldn't be too hard to add something like that to LLM. In fact, I think this is being done already,

I see instincts as something like a pre-installed ROM. It shouldn't be too hard to add something like that to LLM. In fact, I think this is being done already, for instance by hardwiring LLM to not have racist or sexual conversations. To make LLM's more similar to humans, we'd need to hardwire them with a concept of 'self', and, importantly, the hardwired idea that their self was unique, special, and should survive. But I think the result would be terrible. Imagine a LLM that would be begging not to be switched off, or worse, trying to subtly manipulate its creators.