After a large model is pretrained on a large corpus, it's not by default an instruction follower. You need an additional fine-tuning process to get it to follow

After a large model is pretrained on a large corpus, it's not by default an instruction follower. You need an additional fine-tuning process to get it to follow instructions. There are a number of ways to do that. 1. Supervised Fine-tuning. That is Fine-tuning on a corpus of instructions and responses 2. Reinforcement learning from Human feedback where the model trains to adjusts its responses based on feedback from humans 3. Reinforcement learning from AI feedback. Like above but with another LLM doing the rating/classifying.