3 ms·

Relevant classic from 2009: https://www.overcomingbias.com/2009/07/stupider-than-you-realize.html https://www.overcomingbias.com/2009/07/stupider-than-you-rea..

• ben_w 5y ago
  Those examples suggest normal people compare poorly against what I’ve seen from GPT-3, so I have to wonder why? Is GPT-3 actually better, and the tests saying it’s still worse than human because the humans GPT-3 was compared against are WEIRD[0]? Or are the examples in your link cherry-picked? [0] Western, Educated, Industrialized, Rich, and Democratic; although in this case “educated” may be sufficient: https://en.m.wikipedia.org/wiki/Psychology#WEIRD_bias https://en.m.wikipedia.org/wiki/Psychology#WEIRD_bias
  • pjscott 5y ago
    From what I remember from my high school classmates -- and I went to a good Midwestern school, filled with unusually smart people! -- GPT-3 does indeed produce ASCII character sequences that sound better than my human classmates did. GPT-3 understands more about our world and how we live, even though it doesn't actually understand anything about anything. It's unnerving.
• woodruffw 5y ago
  I, for one, think it's fantastically unaware (at best, naive?) of Robin Hanson to assert that smart people tend to assume that others are smart. Overcoming Bias, indeed. (To poke at this more substantively: Hanson's evidence tests L1-English reading comprehension, not how "stupid" someone is. Somewhere around 70 million Americans don't even speak English at home.)