It has existed for years: Self-Instruct: Aligning Language Models with Self-Generated Instructions https://arxiv.org/abs/2212.10560 https://arxiv.org/abs/2212.

It has existed for years: Self-Instruct: Aligning Language Models with Self-Generated Instructions https://arxiv.org/abs/2212.10560 https://arxiv.org/abs/2212.10560 airoboros: using large language models to fine-tune large language models https://github.com/jondurbin/airoboros https://github.com/jondurbin/airoboros