2 ms·
> Am I crazy for thinking that it's a terrible idea to train any kind of AI on post-AI data? I don't think it's as obvious to me that LLM-generated data is wor
by petesergeant 2y ago
> Am I crazy for thinking that it's a terrible idea to train any kind of AI on post-AI data?
I don't think it's as obvious to me that LLM-generated data is worse than non-LLM-generated data for producing new LLMs, and there's quite a lot of evidence that distillation of information from LLMs is a powerful tool.