Wow, I guess I'm #3. But my idea quickly expanded into a full fledged "credibility index"- because why not keep track of present-day claims they make about thin

Wow, I guess I'm #3. But my idea quickly expanded into a full fledged "credibility index"- because why not keep track of present-day claims they make about things already known to be false? It seems like one in the same issue to me. And wouldn't it make sense to quantify the vagueness/concreteness of statements made? It's easy for a pundit to say something is "dangerous for America" without giving a specific consequence, and people who make specific predictions that are borne out deserve more credit than people who make vague claims that can't be either affirmed or falsified. And from there, why not keep track of how many times a commentator uses equivocating devices like "borders on", "all but certain", "just short of"? And then, what about commentators who keep predicting a specific thing will happen but ascribing different causes to it? You can also measure how "substantive" a commentator tends to be by looking at the frequency with which concrete facts or examples are cited to support their claim, vs. how many times vague subjective judgments are invoked, vs. how many times nothing is brought forward to support the claim at all. You can measure how frequently a commentator tends to repeat the same news event or same analysis. You can take transcripts of their shows and put them into a program that determines what reading level, (in terms of school grades like 7th grade, 9th grade...) their discussion was judged to be at. And there are probably tons of others. Granted, systems like this, if they caught on, could turn around and bite us like those stories about wish-granting genies with a sense of irony- surely this would result in a whole host of unanticipated structural biases generated by such stats that change the character and quality of the discussion; surely pundits would find, even discover, new ways to misinform and adapt to the structure accordingly. But that has already happened. Pundits already speak in a language designed to make as many claims as possible without being on the hook in any way that risks their credibility. So while it would create new biases, I think it would overturn a whole bunch of pre-existing biases that I think are much worse (or at least shed light on them). This is a long-winded way of saying I really want something like this to happen, and to work.