I have had SOTA models stray from factual content in documents I provided them with within 2-3 prompts. They haven't solved anything. They are just fast and lo

I have had SOTA models stray from factual content in documents I provided them with within 2-3 prompts. They haven't solved anything. They are just fast and look good doing what we ask them to do. But they corrupt data with a passion and to that hype just responds: "just give us 10x as much money and compute".