3 ms·

A parameter in a neural network is more comparable to a synapse of which the brain has 100 trillion. And yes, we will get there too one day.

• jaredklewis 5y ago
  That's a good point, but amount of training data these neural networks take doesn't seem compatible to me. If I read all day everyday from the moment I was born until now, I couldn't have read 45 terabytes of text.
  • exporectomy 5y ago
    Don't forget the training that you did before you were born through evolution. It wasn't text but was a bunch of transferrable skills that help us understand text.
    • jaredklewis 5y ago
      Yes, but what we understand about how the process of natural selection shaped the human brain looks even less like a neural network than what we understand about brains. I guess if we want to reduce the comparison to something vague like "the human brain and neural networks both developed over many iterations," I could agree with that, but that doesn't seem very interesting. If the two were actually comparable, it would look more like: 1. Use NN (or GP) to develop set of hyper parameters 2. Give said HP to neural nets that, thanks to the HP, can be trained on a very limited said of data. I am not aware of any successes with methods like these.