I'm not an author on this paper, but I posted it here because it's in my area of research and I think it's a great example of recent excellent results coming fr

I'm not an author on this paper, but I posted it here because it's in my area of research and I think it's a great example of recent excellent results coming from "self improvement" of LLMs. Most of the authors are very well known in the deep learning academic community and have written many high impact papers between them. Many researchers believe that using synthetic data and automatic classification/scoring, i.e. using LLMs to improve LLMs, is likely to be one of the most successful lines of research. We've been seeing a lot of success from this in recent months, including OpenAI's DALL-e 3, which used (IIRC) 99% synthetic LLM data for captions.