3 ms·
Evolutionary training is not just inductive bias. They're not comparable at all lol. And the more inductive bias we've shoved into models, the worse they've pe
by famouswaffles 3y ago
Evolutionary training is not just inductive bias. They're not comparable at all lol.
And the more inductive bias we've shoved into models, the worse they've performed. Transformers have a lot less bias than either RNNs or CNNs and are better for it. Same story with what preceded both.
- kelseyfrog 3y agoThis is a good time to stop and ask, what point do you think I'm making?
- stevenhuang 3y agoPretty much all of your assertions in this thread and https://news.ycombinator.com/item?id=37797108 https://news.ycombinator.com/item?id=37797108 in particular are what we're disagreeing with.
- kelseyfrog 3y agoRight, I'm checking that you understand what point I'm making by asking you to reflect it.