4 ms·
> i guess brain's synaptic precision could go way lower, as low as 26 distinct synapse weights: https://elifesciences.org/articles/10778 https://elifesciences.o
by quotemstr 7y ago
> i guess brain's synaptic precision could go way lower, as low as 26 distinct synapse weights: https://elifesciences.org/articles/10778 https://elifesciences.org/articles/10778
Thanks for the link. Artificial neural networks all the way down to binary weights [1] although this approach doesn't seem like the most efficient one. It's interesting how we're still seeing a ton of variability in ML architectures: it suggests we haven't stumbled on the right area yet. It reminds me how early aviation had a huge diversity of aircraft plans, but now, after a lot of optimization, we've settled on that one standard airliner shape everyone uses everywhere.
[1] https://arxiv.org/abs/1602.02830 https://arxiv.org/abs/1602.02830
- buboard 7y agoA formal theory of deep learning is proving to be much more elusive that avionics. Interesting times though