4 ms·Generally (not just for LLMs) this is called student-teacher training and/or knowledge distillation.by gugagore 2y agoGenerally (not just for LLMs) this is called student-teacher training and/or knowledge distillation.calf 2y agoIt reminds me of when I take notes from a textbook then intensively review my own notessolardev 2y agoAnd then when it comes time for the test, I end up hallucinating answers too.