Reminded of this approach where a tiny model was trained children's stories generated by a larger model: https://www.quantamagazine.org/tiny-language-models-th

Reminded of this approach where a tiny model was trained children's stories generated by a larger model: https://www.quantamagazine.org/tiny-language-models-thrive-with-gpt-4-as-a-teacher-20231005/ https://www.quantamagazine.org/tiny-language-models-thrive-w...