3 ms·
Isn't that what they meant by this? > the comparison is not apples-to-apples, because each synapse is much more complex than a single parameter in a weight mat
by mort96 2y ago
Isn't that what they meant by this?
> the comparison is not apples-to-apples, because each synapse is much more complex than a single parameter in a weight matrix.
- daveguy 2y agoIt isn't just "not apples to apples". It's apples to supercomputers.
- legacynl 2y agowell yeah but it's un-obviously a very big difference that basically invalidates any conclusion that you can make with this comparison.
- mort96 2y agoI don't think so: it seems reasonable to assume that biological neurons are strictly more powerful than "neural network" weights, so the fact that a human brain has 3 orders of magnitude more biological neurons than language models have weights tells that we should expect, as an extreme lower bound, 3 orders of magnitude difference.