> It simplifies prompting and makes the LLM more steerable, more useful, more helpful. While this is true, there is also evidence that RLHF and supervised inst

> It simplifies prompting and makes the LLM more steerable, more useful, more helpful. While this is true, there is also evidence that RLHF and supervised instruction tuning can hurt output quality and accuracy[1], which are instead better optimized through clever prompting[2]. [1] https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tracing-Emergent-Abilities-of-Language-Models-to-their-Sources-b9a57ac0fcf74f30a1ab9e3e36fa1dc1 https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tr... [2] https://yaofu.notion.site/Towards-Complex-Reasoning-the-Polaris-of-Large-Language-Models-c2b4a51355b44764975f88e6a42d4e75 https://yaofu.notion.site/Towards-Complex-Reasoning-the-Pola...