3 ms·
The optimization process adjusts the weights of a computational graph until the numeric outputs align with some baseline statistics of a large data set. There i
by ainoobler 2y ago
The optimization process adjusts the weights of a computational graph until the numeric outputs align with some baseline statistics of a large data set. There is no "punishment" or "reward", gradient descent isn't even necessary as there are methods for modifying the weights in other ways and the optimization still converges to a desired distribution which people claim is "intelligent".
The converse is that people are "just" statistical distributions of the signals produced by them but I don't know if there are people who claim they are nothing more than statistical distributions.
I think people are confused because they do not really understand how software and computers work. I'd say they should learn some computability theory to gain some clarity but I doubt they'd listen.
- bubblyworld 2y agoIf you really want to phrase it that way, organisms like us are "just" distributions of genes that have been pushed this way and that by natural selection until they converged to something we consider intelligent (humans). It's pretty clear that these optimisation processes lead to emergent behaviour, both in ML and in the natural sciences. Computability theory isn't really relevant here.
- ainoobler 2y agoI don't even know where to begin to address your confusion. Without computability theory there are no computers, no operating systems, no networks, no compilers, and no high level frameworks for "AI".
- deleted 2y ago[deleted]
- bubblyworld 2y agoWell, if you want to address my "confusion" then pick something and start there =) That is patently false - most of those things are firmly in the realm of engineering, especially these days. Mathematics is good for grounding intuition though. But why is this relevant to the OP?
- ainoobler 2y agoThere is no reason to do any of that because according to your own logic AI can do all of it. You really should sit down and ponder what exactly you get out of equating Turing machines with human intelligence.
- bubblyworld 2y agoSorry, I edited my reply because I decided going down that rabbit hole wasn't worth it. Didn't expect you to reply immediately. I'm not equating anything here, just pointing out that the fact that AI runs in software isn't a knockdown argument against anything. And computability theory certainly has nothing useful to say in that regard.
- ainoobler 2y agoRight.
- bubblyworld 2y agoWell, you know, elaborate and we can have a productive discussion. The way you keep appealing to computability theory as a black box makes me think you haven't actually studied that much of it.
- ainoobler 2y agoNot much to discuss.
- deleted 2y ago[deleted]