4 ms·
> Backpropagation, which most researchers will agree is an AI algorithm, is a "simple algorithm". As time rolls on and we see more articles like this one calli
by cr0sh 7y ago
> Backpropagation, which most researchers will agree is an AI algorithm, is a "simple algorithm".
As time rolls on and we see more articles like this one calling out the "AI BS" - which I agree should be called out...
I worry that a new "winter" will set in, and funding will be cut, and research towards how biological neural networks actually work vis-a-vis artificial neural networks will suffer.
Because from what I understand, we currently don't know how such biological networks actually "learn" - because there isn't a "mechanism" for backpropagation to occur.
IIRC, there's still questions on how information is propagated through biological networks; our artificial representations of them are constrained to approximately a single dimension of the real thing (and even that doesn't capture the biology, thus the idea of "spiking neural networks") - but there may be other avenues of information diffusion that are important as well, still to be revealed in the biological makeup.
We know for certain we are missing something fundamental, when even if you could scale up some of today's best deep learning systems to data center scale won't approximate anything close to what goes on in the human brain, given the size and power constraints.
Figuring this out could be set back, when funding becomes scarce once more.
- autokad 7y agoa lot of people think it will mirror how the internet was. Lots of hype, people threw money at it while not really understanding it but when the profits didn't roll in, the winter came. People forget how tech was desolate, and it wasn't just 2001. probably from 2001 to somewhere in 2005? Anyhow, those who figured out how to make use of the internet well were incredibly successful. Once the winter was over tech has been among the hottest industries for a long time. AI might end up the same, enter a winter. people will talk about how silly endevours into AI where, but a few companies will really figure it out and a huge explosion will occur and people will wonder how anyone did anything without AI. something like that for those who forgot what that winter was like: 1999 2:10: your not a pure internet company... (insinuating thats bad) https://www.youtube.com/watch?v=GltlJO56S1g&t=316s https://www.youtube.com/watch?v=GltlJO56S1g&t=316s .com bubble burst somewhere March, 2001 2002 2:22: netflix represents one of the few success stories of an otherwise desolute tech sector https://www.youtube.com/watch?v=YBLAwGhyV5k https://www.youtube.com/watch?v=YBLAwGhyV5k 2004 who in their right mind brings a company to market in the doldrums of august in a down tech... https://www.youtube.com/watch?v=HxOoeCHc47Q https://www.youtube.com/watch?v=HxOoeCHc47Q