> I am curious to know more about the limitations / perils of using LLMs to train/evaluate other LLMs. the entropy goes up in such case (up means less informat

> I am curious to know more about the limitations / perils of using LLMs to train/evaluate other LLMs. the entropy goes up in such case (up means less information). The result will be as if someone recompressed mpeg with another lossy compression. You can sometimes see the results on the internet.