I mean, there is plenty of "experience" codified in the raw internet scrape they used. But not enough for LLMs, and not in-domain. So it won't contain the kind

I mean, there is plenty of "experience" codified in the raw internet scrape they used. But not enough for LLMs, and not in-domain. So it won't contain the kind of errors LLMs make and corrective feedback.