I honestly don't understand what they were thinking. Transformer-style language models are clearly unsuitable for this task. Starting with a foundation that is

I honestly don't understand what they were thinking. Transformer-style language models are clearly unsuitable for this task. Starting with a foundation that is known to "hallucinate"[1] in this context strikes me as just crazy. There is no way to start with a hallucinating foundation and then try to purge the hallucinations at some higher level; characterizing the "shape" of "the output of this model - the errors this model makes" is a super complicated N-dimensional space no current AI model has any hope of characterizing. I'm pretty sure that space is straight-up super human. If such an AI is possible, and I won't promise it isn't, it will certainly not be based on a transformer model. I also won't promise it won't "incorporate" such a thing, but it can not be the base. [1]: Not sure I love this word, I think I'd prefer "confabulate", but hey, I'll run with it.