5 ms·

> Please. Yes, NN are still in their infancy but they are clearly foundational to general intelligence. This calls for a big fat "citation needed". What we cal

by c-cube 6y ago

> Please. Yes, NN are still in their infancy but they are clearly foundational to general intelligence. This calls for a big fat "citation needed". What we call neural networks have very little to do with actual neurons, so I fail to see how this is supposed to be "clear". And it's in its infancy since the sixties, really?

aardvarkr 6y ago
What about electric cars, since they've been around for 180 years? Is it wrong to say that EV tech is in its infancy? We're seeing significant innovation in electric vehicles and there's so much room for it to continue improving. Technology goes through periods of explosive innovation as well as periods of very little growth. NN's were dead until they weren't, and now they are having quite the renaissance ever since 2012. Currently they seem to be getting us closest to general intelligence and I'm excited to see where they go from here and if anything else comes along to supplant it's place on the throne.
nonameiguess 6y ago
Technically, the perceptron was developed in the 50s, and it's kind of hilarious to read the original press release which claimed it was going to be conscious of its own existence.
throwaway316943 6y ago
I’d say it’s clear since we continue to make significant progress in replicating the behaviour of biological NNs with the main limitation being the amount of parallelism we can throw at it. If you read closely I stated that our model of the neuron may require modification but the basic idea is correct. Our implementation of artificial NN is in its infancy, we still don’t fully understand how to structure these networks and the way we feed them data is nowhere close to how biological NNs get theirs from the environment but the current SOTA is necessary because we don’t know how to build something capable of operating in the same way. We still have a lot to learn. We’re competing with hundreds of millions of years of evolutionary exploration using our fairly rudimentary understanding of biology. 60 years is nothing especially considering progress is not inevitable and this area of science has major boom and bust cycles where not a lot gets done.

by c-cube 6y ago

aardvarkr 6y ago

What about electric cars, since they've been around for 180 years? Is it wrong to say that EV tech is in its infancy? We're seeing significant innovation in electric vehicles and there's so much room for it to continue improving. Technology goes through periods of explosive innovation as well as periods of very little growth. NN's were dead until they weren't, and now they are having quite the renaissance ever since 2012. Currently they seem to be getting us closest to general intelligence and I'm excited to see where they go from here and if anything else comes along to supplant it's place on the throne.

nonameiguess 6y ago

Technically, the perceptron was developed in the 50s, and it's kind of hilarious to read the original press release which claimed it was going to be conscious of its own existence.

throwaway316943 6y ago

I’d say it’s clear since we continue to make significant progress in replicating the behaviour of biological NNs with the main limitation being the amount of parallelism we can throw at it. If you read closely I stated that our model of the neuron may require modification but the basic idea is correct. Our implementation of artificial NN is in its infancy, we still don’t fully understand how to structure these networks and the way we feed them data is nowhere close to how biological NNs get theirs from the environment but the current SOTA is necessary because we don’t know how to build something capable of operating in the same way. We still have a lot to learn. We’re competing with hundreds of millions of years of evolutionary exploration using our fairly rudimentary understanding of biology. 60 years is nothing especially considering progress is not inevitable and this area of science has major boom and bust cycles where not a lot gets done.