It occurs to me that the bitter lesson is so often repeated because it involves a slippery slope or moot-and-castle argument. IE, the meaning people assign to

It occurs to me that the bitter lesson is so often repeated because it involves a slippery slope or moot-and-castle argument. IE, the meaning people assign to the bitter lesson ranges between all the following: General-purpose-algorithms-that-scale will beat algorithms that aren't those The most simple general purpose, scaling algorithm will win, at least over time Neural networks will win LLMs will reach AGI with just more resources