One of the big subtle problems is designing the broader interaction so that the humans in the loop are both capable and motivated to do a proper review of every

One of the big subtle problems is designing the broader interaction so that the humans in the loop are both capable and motivated to do a proper review of every item that will occur. LLMs are able to counterfeit a truly impressive number of indirect signals which humans currently use to make snap-judgements and mental-shortcuts, and somehow reviewers need to be shielded from that.