3 ms·

When you think about AI as simply being matrix multiplication, you get a clear answer. I can't believe anyone who's involved in the technical aspects of ML/AI a

When you think about AI as simply being matrix multiplication, you get a clear answer. I can't believe anyone who's involved in the technical aspects of ML/AI as it stands today would even entertain this.

eulenteufel 4y ago
Matrix multiplications are linear. Modern neural network methods usually make heavy use of nonlinearities. You could also say that quantum mechanics is just matrix multiplications, but look where it got us.
aaaaaaaaaaab 4y ago
Matrix multiplication, followed by a nonlinear function. Rinse and repeat many times, and it can approximate arbitrarily complex functions. So the only way out of it is declaring that sentience cannot be described by a function.
- eulenteufel 4y ago
  This is known as Universal approximation theorem[0] [0] https://en.wikipedia.org/wiki/Universal_approximation_theorem https://en.wikipedia.org/wiki/Universal_approximation_theore...
  - im3w1l 4y ago
    Lookup tables can do universal approximation, but few would call them sentient or even intelligent.
jawns 4y ago
I could see it being the case if the person believes that at its core, our own human sentience IS really just advanced matrix multiplication (or other purely material processes, i.e. we're all just fleshy mainframes). So, such a person might conclude that with sufficiently advanced matrix multiplication and other similar functions, any entity could achieve the same sort of sentience as us.
jnwatson 4y ago
When you think about human sentience simply being electrochemical gradients among neurons, you get a clear answer. I can’t believe anyone who’s involved in the technical aspects of neuroscience would believe that humans are sentient.
- saberience 4y ago
  Definition: sentient - able to perceive or feel things. Ah ok, so you're saying that neuroscientists would say that nobody is sentient including themselves? Hmm, somehow I don't find your argument convincing.
lern_too_spel 4y ago
MLPs are universal function approximators, so it is possible to make one that will approximate a human brain. LaMDA isn't that.

eulenteufel 4y ago

Matrix multiplications are linear. Modern neural network methods usually make heavy use of nonlinearities. You could also say that quantum mechanics is just matrix multiplications, but look where it got us.

aaaaaaaaaaab 4y ago

Matrix multiplication, followed by a nonlinear function. Rinse and repeat many times, and it can approximate arbitrarily complex functions. So the only way out of it is declaring that sentience cannot be described by a function.

eulenteufel 4y ago
This is known as Universal approximation theorem[0] [0] https://en.wikipedia.org/wiki/Universal_approximation_theorem https://en.wikipedia.org/wiki/Universal_approximation_theore...
- im3w1l 4y ago
  Lookup tables can do universal approximation, but few would call them sentient or even intelligent.

jawns 4y ago

I could see it being the case if the person believes that at its core, our own human sentience IS really just advanced matrix multiplication (or other purely material processes, i.e. we're all just fleshy mainframes). So, such a person might conclude that with sufficiently advanced matrix multiplication and other similar functions, any entity could achieve the same sort of sentience as us.

jnwatson 4y ago

When you think about human sentience simply being electrochemical gradients among neurons, you get a clear answer. I can’t believe anyone who’s involved in the technical aspects of neuroscience would believe that humans are sentient.

saberience 4y ago
Definition: sentient - able to perceive or feel things. Ah ok, so you're saying that neuroscientists would say that nobody is sentient including themselves? Hmm, somehow I don't find your argument convincing.

lern_too_spel 4y ago

MLPs are universal function approximators, so it is possible to make one that will approximate a human brain. LaMDA isn't that.