Great article! Agree with everything mentioned. Good to share with all tech people who don't work in the AI space and "hallucinate" about working of LLMs. Havi

Great article! Agree with everything mentioned. Good to share with all tech people who don't work in the AI space and "hallucinate" about working of LLMs. Having said that, although LLMs don't directly learn from what we say to them, they can for sure create a representation or persona using Representation Engineering. Quoting from an excellent article by Theia Vogel [1]: "In October 2023, a group of authors from the Center for AI Safety, among others, published Representation Engineering: A Top-Down Approach to AI Transparency. That paper looks at a few methods of doing what they call 'Representation Engineering': calculating a 'control vector' that can be read from or added to model activations during inference to interpret or control the model's behavior, without prompt engineering or finetuning. (There was also some similar work published in May 2023 on steering GPT-2-XL.) Previously on HN 3 months ago: [2] [1] https://vgel.me/posts/representation-engineering/ https://vgel.me/posts/representation-engineering/ [2] https://news.ycombinator.com/item?id=39414532 https://news.ycombinator.com/item?id=39414532