I come from the same background, and I think you're absolutely on the right track. Whenever I peck away at these models, it takes about 3 minutes before I'm tos

I come from the same background, and I think you're absolutely on the right track. Whenever I peck away at these models, it takes about 3 minutes before I'm tossing it away because it's on another BS path, or yet another pathological output stream (read: one that I know is wrong from prior experience). The only interesting application I've come up with for them is to pair it with low confidence/knowledge people and use it as "the idiot in the room" spewing half or non-truths to sharpen that persons BS filters/prime them with a different direction to shift research in. Trying to do any substantive conversation with them is nigh on impossible due to the lack of recollection/memory/lookback and blissful meta-unawareness of it's own lacking it. It's a bit like trying to reason through something with a person suffering from dementia.