Validating and updating memory is an interesting problem with an LLM. Is it true that the next iteration of GPT is being trained with artificial data and that

Validating and updating memory is an interesting problem with an LLM. Is it true that the next iteration of GPT is being trained with artificial data and that data is being validated by GPT-3.5? That LLMs may hallucinate but when prompted are actually pretty good at knowing when a conclusion is wrong?