Personall I was surprised a lot of functional prompts include "you are xxx" at the top and it works. I also tested it as pretty effective in certain models(GPT)

Personall I was surprised a lot of functional prompts include "you are xxx" at the top and it works. I also tested it as pretty effective in certain models(GPT) and not in others (Bloom) . As those are essentially text generation / continuation models one could expect them to continue in the same fashion. An example from the article. Prompt "You are an assistant helping a user write more content(..) Use markdown (...) Do not use links". Here I would expect the AI to output something like a literal continuation of the prompt for example: "Make it interesting and engaging. Keep it to 5 pages long" etc. However, we see an actual output as we expect. This leads me to believe those models were trained on specially crafted materials that contain stuff in this format. I wonder how much and if it was human written or generated. This makes one realise the training data is really what makes the model. Just looking at a difference in chatgpt (supposedly 11b+ words training set) being much better than (bloom 300b words training set) illustrates it well.