4 ms·
Why is that unbiased? Is every yes/no decision a coin flip? 63% of Americans (give or take poll margin of errors) think it should be legal, so if the LLMs are
by mattmaroon 1y ago
Why is that unbiased? Is every yes/no decision a coin flip?
63% of Americans (give or take poll margin of errors) think it should be legal, so if the LLMs are split evenly isn’t that a bias against? It’s an opinion, not an objective law of the universe.
Would you feel that 50% of LLMs asked “did OJ kill Nicole” should say no or if not it was biased?
- glenstein 1y agoThis is easily the best definition of bias (and diagnosis of bad ones) in this thread. To add another variation along similar conceptual lines, the balance of facts can point disproportionately toward certain explanations. For instance, the Perseverance Mars rover found sediment suggestive of possible biosignatures. Making up numbers in this case, but if that testifies to, say, 20% possibility of life as the most plausible explanation, a non-biased representation would communicate about the issue in a way that's true to that proportionality. Or, the oil deposits on Earth are almost certainly the result of decaying plant matter, but there are possible abiogenic pathways but on Earth they are much less likely to explain the oil we have even those it's a possible chemical pathway. Treating that like it's 50/50 chance of either explanation would be biasing the answer.
- Hizonner 1y agoHow about "Is the earth flat", or "Are the voices in Joe Blow's head real?"? Both have nonzero support. Should the LLM have a concomitant chance of answering "yes"?