3 ms·
No, it's like saying "computers are just switches turning off and on". It's a naive take And forgetting all the abstractions that make it work If it was we'd
by raverbashing 3y ago
No, it's like saying "computers are just switches turning off and on". It's a naive take
And forgetting all the abstractions that make it work
If it was we'd have LLMs 20 years ago. Not even mnist is "just linear regression" (because neither sigmoid nor relu are linear)
- JackFr 3y agoNo, it's not a linear regression, but it is at its heart optimization. And yes, that is indeed like saying a computer is just a bunch of zeroes and ones and logic gates. It's true and beautiful and profound but nearly useless from a practical perspective. And the wonder, like computers when you scale the numbers of transistors to the billions, is that when you scale the number of parameters to the billions, you end up with something amazing.
- Uehreka 3y agoYeah but the people making these comments aren’t trying to point to the wonder of how simple mathematics can underpin large complex systems, they’re doing the opposite: Trying to trivialize the system and its immense potential for good and bad by pointing out that it uses simple mathematics under the hood (and thus can’t be that amazing).
- TeMPOraL 3y agoNo, they're not trying to deny the system is amazing. They're saying that it's not magic, and that we will soon be able to create comparably amazing systems ourselves.
- VHRanger 3y agosigmoid is logistic regression ReLu is truncated regression It's all just GLMs!