4 ms·
I think with sufficiently good technology the human brain, too, could be modeled with just math. So far, it seems like basically everything in the universe can
by dilap 4y ago
I think with sufficiently good technology the human brain, too, could be modeled with just math. So far, it seems like basically everything in the universe can be described as just math!
ChatGPT is a neural network, a design inspired (loosely) by the human brain. How exactly it works is still not known. Like of course the raw details of how the computations work is known, but why the particular trained weights are what they are, and how the thinking actually happens is not known (so far as I know).
But I think it must be more than just something like looking up a conditional probability table -- calculate out the size of a conditional probabiltty of 8000 tokens or whatever and it'll be way way way more than the number of parameters of the model.
And no doubt as it stands ChatGPT is still far inferior to human intellect.
But I would note that making mistakes doesn't mean something like thinking isn't happening -- humans make mistakes all the time, often very dumb ones!