4 ms·
Matrix multiplication with a different function and weights for each input/output. That’s the primary operation. There are many other operational modes overlai
by K0balt 3y ago
Matrix multiplication with a different function and weights for each input/output. That’s the primary operation.
There are many other operational modes overlaid that we typically do not model with mainstream models, but they primarily act as broad modifiers (suppression, gain, etc) we understand very well how it works, for example, when we get a few brain cells together to play pong or doom. We can transcribe the functionality of these simple biological networks, once trained, onto models and they function as expected.
The simplified computational model we use for neural networks closely models the primary mechanism, but lacks self reinforcement systems, biochemical moderators, self directed connectivity modifications, etc. Basically we do the training with a separate process for most of the systems in common use, in contrast with biological systems which self organise and train in-situ.
- seanhunter 3y agoI notice that you’re consistently just claiming that the biological system does linear algebra without any source for this.
- K0balt 3y agoI’m not claiming that biological systems “do” linear algebra, I’m claiming that their behaviour can be partially modelled using linear algebra. If I gave the impression that I thought they were actually computing linear algebra I apologise for my unclear writing. But AFAIK modeling neural network nodes with linear algebra is a foundational principle and has been for quite some time, since I first started messing with neural networks 30 years ago. But hey, maybe you’re right and computational neural networks aren’t roughly modelled after their biological counterparts and I’ve just misunderstood the field all this time. I guess the good thing about neural networks is you don’t really have to understand them completely to use them lol. That said, if you’ve got information that refutes the notion that they are roughly modelled after their biological counterparts, or that somehow linear algebra is not the right tool for modelling them, I’d sure be interested to see it. Just because I’ve ben doing something for decades doesn’t mean I haven’t been doing it -wrong- for decades lol. Wouldn’t be the first thing.