3 ms·
This is the bitter lesson.[1] I too used to think that rule-based AI would be better than statistical, Markov chain parrots, but here we are. Though I still t
by GMoromisato 10mo ago
This is the bitter lesson.[1]
I too used to think that rule-based AI would be better than statistical, Markov chain parrots, but here we are.
Though I still think/hope that some hybrid system of rule-based logic + LLMs will end up being the winner eventually.
----------------
[1] https://en.wikipedia.org/wiki/Bitter_lesson https://en.wikipedia.org/wiki/Bitter_lesson
- beepbooptheory 10mo agoThese days its pretty much the "sweet" lesson for everyone but Sutton and his peers it seems.
- zavec 10mo agoIt's bitter for me because I like looking at how things work under the hood and that's much less satisfying when it's "a bunch of stats and linear algebra that just happens to work"
- warkdarrior 10mo agoSo you prefer "a bunch of electrons, field effects, and clocks than just happen to work"?
- schoen 10mo agoIf you're building on a computer language, you can say you understand the computer's abstract machine, even though you don't know how we ever managed to make a physical device to instantiate it!