The bitter lesson is a good demonstration of how people have really short memories and distributed work loses information Every AI "breakthrough" comes at a la

The bitter lesson is a good demonstration of how people have really short memories and distributed work loses information Every AI "breakthrough" comes at a lag because the people who invent a new architecture or method aren't the ones who see its full potential. Because of the financial dynamics at play, the org or team that sees the crazy-looking result often didn't invent the pieces they used. Even if they did, it's been years and in a fast-moving field that stuff has already started to feel "standard" and "generic". The real change they saw was something like more compute or more data Basically, even the smartest people in the world are pretty dumb, in the sense of generalizing observations poorly