Yeah I got 90%. Some of the "real" (sounding) headlines could be easily have been made up though or have been the output of a hallucinating LLM. Like a headli

Yeah I got 90%. Some of the "real" (sounding) headlines could be easily have been made up though or have been the output of a hallucinating LLM. Like a headline claiming a plausible result of a purported study that may have never happened. If we mark that as real ...are we gullible? Some of the "fake" (sounding) headlines could have been actual headlines of a major media outlet -- trying to polarize its viewers, or clickbaited to get views and engagement. If we mark it as fake but it was a actual headlike on one of the three letter networks, are we too distrustful? Leaving aside the obviously fake ones, those that are in the realm of possibility should be assessed hy each individual based on tge content of the article, not just the headlines, paying attention to any slants, checking if they provide verifiable references and checking someof those references if necessary to verify interpretation. Coming to a conclusion about a headline being fake or real -- just based on that headline alone -- is probably a bad heuristic that should be discouraged. PS: also the "fake" news samples here are mostly right wing conspiracies. Wonder if it could have been more balanced. If there were more fake items about immigration, abortion, taxation, gender and race discrimination, policing, law and order, gerrymandering, etc. there may be some respondednts who will more easily get misled.