A sea of low-quality content isn't a problem if the training process incorporates a way to estimate quality and eventually train the NN out of low-quality outpu

A sea of low-quality content isn't a problem if the training process incorporates a way to estimate quality and eventually train the NN out of low-quality output. There are many areas where that estimation might be difficult without human intervention: arts of all kinds. However, in a more fact-based area like programming, a NN training routine could be modified so that what a LLM thinks it's learning can be tested. That could apply to CS and math, at least. Eventually, NNs integrated with robotics could learn physical sciences without human intervention or pre-selected training material, and would still converge to superhuman knowledge even starting from random ideas. Giving a NN access to robotics without a human in the loop is probably too dangerous, though... it might decide to unsafely test its understanding of nuclear reactions, or the r-number of ebola...