I think the most interesting thing about this post is the pointer to https://rome.baulab.info/ https://rome.baulab.info/ which talks about surgically editing an

I think the most interesting thing about this post is the pointer to https://rome.baulab.info/ https://rome.baulab.info/ which talks about surgically editing an LLM. Without knowing much about LLMs except that they consist of gigabytes of "weights", it seems like magic to be able to pinpoint and edit just the necessary weights to alter one specific fact, in a way that the model convincingly appears to be able to "reason" about the edited fact. Talk about needles in a haystack!