9 ms·
Study urges caution when comparing neural networks to the brain
- buscoquadnary 4y ago
- gryBrd1987 4y agoI sometimes wonder how much further along these initiatives might be if the economy was focused on them instead of My Pillow sales, cheap crap from Walmart, and simply handing personally wealthy elites stacks of cash to create pointless jobs and the money was put into net new technology, not Twitter 2.0 and VR 4.0
- te_chris 4y agoMove to China or North Korea I guess? Still seems to have problems with graft though.
- gryBrd1987 4y agoAh the exceptional minds of the US. “If it smells like a violation of politically correct tradition as I know it, it’s communism!”
- te_chris 4y agoNot American, but you asked for planned economy: those are it.
- f6v 4y agoChina is definitely not a “planned economy” in a sense that you meant it. Also, every economy is planned in some sense. Every government plans how much it’s going to make and spend.
- gryBrd1987 4y agoSo all these US businesses do zero planning? The Fed is raising rates for lulz? We’ve unintentionally allowed consolidation of ownership? No one has any clue? You’re nitpicking semantics.
- nightski 4y agoWho needs to eat or sleep, it just hurts productivity.
- themitigating 4y agoThe parent didn't suggest cutting off food, housing, or other essentials.
- mwint 4y agoTechnically, everyone in Soviet Russia had food and housing.
- gryBrd1987 4y agoTechnically the US has more people in prison than China, and QOL metrics have all been dropping for decades. Crack epidemic. Prescription drug epidemic. RvW being gutted. Let’s sit and fear becoming a nation state that collapsed 30 years ago while ignoring we’re already on the path.
- f6v 4y agoHave you lived there?
- deleted 4y ago[deleted]
- yboris 4y agoThe meme of fusion being "5 years from now ... for past 40 years" is so frustrating. This is because the investment into it went down to abysmal -- not even "maintenance" level of when it was just getting started. If the government spent money on it, we would likely have more progress. And today isn't like it was before -- we have ReBCO ;)
- otikik 4y agoWe just need to figure out how to align the carbon nanotubes properly
- deleted 4y ago[deleted]
- ben_w 4y agoAGI is somewhere between "never" and "GPT-3 is it", depending on how general the G has to be and how intelligent the I has to be. (For all it's flaws, GPT-3 is already does better at random professional knowledge than many TV show script writers).
- deleted 4y ago[deleted]
- kgarten 4y agothis article makes me sad ... a neural network can be also a network of biological neurons, the author means artificial neural network https://en.m.wikipedia.org/wiki/Neural_network https://en.m.wikipedia.org/wiki/Neural_network the Wikipedia article even goes into the differences, so why did we need a study for that? A study urges caution comparing Jellyfish to Jelley ... tasters found they are not the same (even though I hear that fried jellyfish taste nice...) study urges caution comparing the model to the real thing, as the model has some generalizations the real thing does not ...
- Barrin92 4y agothe motivation is also in the article, because the original research that suggested similarities in activity only achieved this by doing it under conditions that are implausible in biological systems, therefore that original research likely was misleading.
- kgarten 4y agomy point was that the architecture and models are so fairly different that at least the title is trivial. Nobody even the original research claimed that. the suggested research and the paper in question deal with grid cells and how they emerge ... Still artificial neural networks are summations over functions ... vastly different from our brain neural network. so yes caution is advised, yet that point and the title is so obvious that we don't need a paper for it. my assumption, the author hides the rather technical contribution of the paper behind a tautology to get some attention. seemed to have worked on hackernews as it's on the front page.
- gryBrd1987 4y agoThe brain is not involved in a whole lot of behaviors though. Cells organize themselves to an extent. Cuts heal without us focusing conscious thought on them. The brain is a hard drive but the body is the whole computer. Science is proving physical causation. Not just writing down what we want to be true.
- 4y ago
- nathias 4y agophilosophers caution when comparing an analogy to a thing
- cirgue 4y agoI think it’s also important to highlight that the analogy between neural networks and brains is to help people visualize what a neural network is, not what a brain is. It’s really just to convey the idea of multiple nodes passing information to one another. After that point, the comparison is useless because the two systems diverge so wildly outside of that one (pretty loose) conceptual connection.
- dekhn 4y agoalso the map is not the territory
- adharmad 4y agoThis is a very old article by Francis Crick which essentially says the same: https://www.nature.com/articles/337129a0 https://www.nature.com/articles/337129a0
- babblingfish 4y agoAs someone who studied Neuroscience in college, I remember this paper and some other examples showing just how different computational neural networks are from real neurons. It's difficult for me to believe that professional researchers could really believe a NN is an accurate model of the real deal. The paper also does not have any reference to a study or paper that explicitly states that a neural network is a good model for grid cells. (Please correct me if I am wrong.) So I am left wondering why this direction was chosen. Maybe it's a little cynical, but this topic seems to have been chosen (at least in part) to produce a splashy headline. Or in other words, to give the Stanford and MIT PR engine something to print. This is the sort of obvious thing we all knew to be true. Why people with access to lab animals and a fully stocked microbiology lab needed to prove it (again) I do not understand.
- jcims 4y agoAndrej Karpathy was recently on Lex Fridman's podcast and covered this to some extent. He has the same perspective on this topic and expanded on it quite a bit. Great listen overall IMHO - https://www.youtube.com/watch?v=cdiD-9MMpb0 https://www.youtube.com/watch?v=cdiD-9MMpb0 I like his idea of finding 0-days in physics. :)
- nvrspyx 4y agoFrom the actual study's abstract: > Unique to Neuroscience, deep learning models can be used not only as a tool but interpreted as models of the brain. The central claims of recent deep learning-based models of brain circuits are that they make novel predictions about neural phenomena or shed light on the fundamental functions being optimized... Using large-scale hyperparameter sweeps and theory-driven experimentation, we demonstrate that the results of such models may be more strongly driven by particular, non-fundamental, and post-hoc implementation choices than fundamental truths about neural circuits or the loss function(s) they might optimize. Finally, we discuss why these models cannot be expected to produce accurate models of the brain without the addition of substantial amounts of inductive bias, an informal No Free Lunch result for Neuroscience. In conclusion, caution and consideration, together with biological knowledge, are warranted in building and interpreting deep learning models in Neuroscience. And IMO a succinct description of the problematic assumption being cautioned against in the study's introduction section: > Broadly, the essential claims of DL-based models of the brain are that 1) Because the models are trained on a specific optimization problem, if the resulting representations match what has been observed in the brain, then they reveal the optimization problem of the brain, or 2) That these models, when trained on sensibly motivated optimization problems, should make novel predictions about the brain’s representations and emergent behavior. --- I think to most, the problem with claim number 2 directly above is obvious, but it's important to also look at claim 1.
- deleted 4y ago[deleted]
- emptybits 4y agoLast week's Lex Fridman podcast featured Andrej Karpathy (former director of AI at Tesla, founding member of OpenAI) and they discussed this aspect briefly also. The usefulness of neural networks has not ceased, despite researchers' early ideas and hopes about its biological analogies having somewhat sheared away.
- lalos 4y agoHere's my guess: neurons tap into quantum mechanics but we are too primitive to understand that for now. The brain was initially modeled as humors/fluids back when we developed aqueducts, then telegraph came into the scene and it was modeled as electrical impulses and now computers/ML are popular therefore we see it as a neural network. Next step is quantum.
- Teever 4y agoBut why is the next step quantum? And why is this the final step?
- tarboreus 4y agoBecause we don't understand quantum physics, and we don't understand the brain. I don't think we know if it's the final step. There could be wizard jelly or something at the bottom.
- marginalia_nu 4y agoQuantum physics is fairly well understood. Perhaps not among laymen, but that's mostly due to pedagogical challenges, which is why a lot of the discourse seems to be stuck approaching it as though we were living nearly 100 years into the past.
- chaxor 4y agoPeople don't understand quantum physics. People also don't understand AGI. Therefore it's obvious that they're related. So it seems clear that AGI will be solved with the help of quantum physics. My aunt Mildred is a very well renown academic and has written much on this topic. She unfortunately is also not well understood. So it seems quite clear - perhaps obvious - that AGI will be solved by applying some Mildred.
- mach1ne 4y agoEh, we might go there, but I don't think the core algorithm that's running in our heads has much to do with quantum-level.
- constantcrying 4y agoTo me one important aspect is the existence of adversarially attacks on neural networks. They essentially prove that the neural network never "understood" its data. It hasn't found some general categories which correspond somewhat to human categories. Human brains can be tricked too, but never this way and never beyond our capacities for rational thought.
- comboy 4y agoOptical illusions is one thing, but, I don't know, "Predictably Irrational", "Thinking fast and slow" or just whatever is happening all around. We do not understand our data. In general yes, I believe most people will only accept thinking machine when it can reproduce all our pitfalls. Because if we see something and the computer doesn't, then it clearly still needs to be improved, even if it's an optical illusion. But our bugs aren't sacred and special. They just passed Darwin's QA some thousands years ago.
- ben_w 4y ago> But our bugs aren't sacred and special. I'd agree about sacred, but I have a hunch they may indeed be special… or at least useful. Current AI requires far more examples than we do to learn from, and I suspect all our biases are how evolution managed to do that.
- marmada 4y agoHumans are trained on petabytes of data. From birth, we ingest sights, sounds, smells etc. Imagine a movie of every second of your life. And an audio track of every second of your life. Etc. Etc. Humans get a lot of data.
- elcomet 4y agoAnd you didn't even count the data from million of years of evolution. The brain doesn't come as a blank slate when you're born.
- random_upvoter 4y agoAny true understanding or new insight originates in the plexus solaris which is near your heart, then somewhat slowly works it way up to the spine. The brain is a somewhat predictable fleshy motor capable of turning the insight into language, storing it in memory, or acting on it. Most of the times we "get by" with the stored procedures in the brain but don't imagine it's the place where original understanding is generated. Funny how the ancient Egyptians understood this but we don't. Of course this is also why all attempts to create AI by simulating what happens in the brain are doomed to hilarious failure.
- bawolff 4y agoThe aspect of ai that makes me think something related is going on, is how artifacts look in image generation systems like stable diffusion. Often these systems will have really bizzare artificats, people with 3 arms, etc. However at the same time when you glance at the output without looking carefully you will sometimes miss these artifacts even though they should be absolutely glaring.
- RosanaAnaDana 4y agoI think anyone who has tripped would also commiserate. Seeing too many eyes or fingers at a glance. Things feeling cartoony or 'shiny'. I don't know if AGI is down the road diffusion models have taken us. I'm not even really sure what most people mean by AI when they talk about it. But stable diffusion et al are clearly super human. I'm not sure that AGI is down the trail cut by diffusion models, but if it's ever accomplished, these models will almost assuredly represwbt some of the learnings required to get there.
- sebmellen 4y agoSeeing my hand covered in eyes while tripping completely changed my view of the mechanisms behind sight. Something that had previously seemed so “real” and deterministic suddenly was no longer; the interpretation layer was momentarily unveiled.
- merely-unlikely 4y agoMy pet (uneducated) theory is that AI needs to have a parent layer "consciousness" before it can become an AGI. Think of that voice inside your head and your ability to control bodily functions without needing to do it all the time. My model is our brains have many specialized "sub AIs" operating all the time (remembering to breathe for example) but then the AI behind the voice can come in and give commands that override the lower level AIs. What you think of as "me" is really just that top level AI but the whole system is needed to achieve general intelligence. Sort of like a company with many levels of employees serving different functions and a CEO to direct the whole thing, provide goals, modify components, and otherwise use discretion.
- cameronfraser 4y agoMost introductory deep learning courses are very clear about how far the analogy goes, if people are interpreting it as something more I don't think it's the fault of practitioners/educators and more the fault of people's imagination and selective hearing.
- vavooom 4y agoIf you are interested in learning about the intersection of Artificial Neural Networks and Biological Neural Network research, I recommend "The Self-Assembling Brain - How Neural Networks Grow Smarter" by Peter Robin Hiesinger. He attempts to bridge research from both fields of study to identify where there are commonalities and differences in the design of these networks.
- esalman 4y agoI second this. You can also check out the brain inspired podcast that features him: https://braininspired.co/podcast/124/ https://braininspired.co/podcast/124/ What I understand is that he claims the underlying algorithms that govern our behavior and how it evolves from birth are ingrained in our genetic code. Current neural network models try to model our behavior, but it is way behind when it comes to discovering those ingrained algorithms.
- bee_rider 4y agoIf they'd just called them "premium matrix multiplications" I bet the field never would have caught on.
- deleted 4y ago[deleted]
- palata 4y agoNo shit.
- icare_1er 4y agoR.Penrose rules.
- tobyjsullivan 4y ago> Study urges caution when comparing neural networks to the brain They keep telling me this and, yet, I can't stop doing it. The more I learn about neural networks, the more I feel like I understand my own brain (whether accurate or not). And conversely, the more I think about thinking, the better my theories about how I'd build ML-based system to solve specific problems (admittedly, most untested). Neural networks seem like too useful of a model to simply give up because they aren't completely accurate. Of course, this is all just for personal use - mostly introspection. I wouldn't exactly do medical work based on the model.
- colechristensen 4y agoPeople always do things like this, like an astrologer trying to say something profound using Heisenberg's uncertainty principle applying it to your romantic relationships, or whatever. These "just so" stories are attractive but it is quite important to realize a metaphor which is intuitive and you perceive as useful is nothing at all like the process for finding real scientific truth. There is also a lot of introspective value to modeling the world as being controlled by mysterious gods who are pleased or appalled at your behavior and that's why good and bad things happen. Perhaps useful for some people but nothing at all like truth. https://en.wikipedia.org/wiki/Just-so_story https://en.wikipedia.org/wiki/Just-so_story
- tobyjsullivan 4y agoThis is definitely what I was thinking about when I started my comment. I torpedoed my own point with the comment about the model being "too useful". Your explanation is much better. When I said "I can't stop," I was referring more to this tendency to borrow models to explain unrelated systems. It's just a thing my brain wants to do and I can't help it (and again, I seem to convince myself that it's somehow accurate or useful even if, rationally, I'm quite sure it's not).
- colechristensen 4y agoYup, unrelated things do indeed often look and behave in similar ways. Humans are just a little bit overdriven to find patterns and end up finding some that don’t exist. It’s a useful trait for finding difficult patterns and there’s probably a stable point to maximize benefits which lands on finding a few too many.
- rufus_foreman 4y agoOther study says if you are comparing neural networks to the brain, just fucking go for it!
- theptip 4y ago> Networks trained on a path integration task almost always learn to optimally encode position, but almost never learn lattice cells (hexagonal or square) to do so... Our main message is that it is highly improbable that DL models of path integration would have produced grid cells as a novel prediction simply from task-training, had grid cells not already been known to exist. This carries on into an extremely nuanced and technical discussion of the architecture of specific models used. It's basically pointing out that in some previous papers, authors thought that grid cells always arose when solving this problem, but in fact this only occurs when specific implementation choices are made. So those papers were incomplete, and the phenomenon isn't as clearcut as before. However! This new complexity still tells us something; if only certain architectural choices produce grid cells, then brains must (in some sense) implement those architectural choices. And the models that don't produce grid cells must be doing something differently to how the brain does things. In summary I think this paper is probably saying a lot less than most people here are reading into it; some papers are accidentally oversimplifying, and we've found more complexity that needs to be explained. More thorough hyperparameter-space exploration can identify brittle results. It's not some deep point about whether it is philosophically or logically consistent to compare deep NNs to the brain.
- danielheath 4y agoIn wet-brains: Interlacing isn't 4-way or 6-way, it's 10e3-way, and each interlaced connection has a weight that's nonlinearly time-dependant based on how long since last firing. Every cyclic connection is potentially a self-sustaining oscillator. None of these features are efficiently implemented in current silicon. "Caution when comparing neural networks to brains" is underselling it. They're profoundly different kinds of network; nobody is building (or even publicly planning) silicon that has that kind of interconnect breadth.
- isaacfrond 4y agoWhat do you mean? Any image classifier will use way more than 4 kernels for convolution. All those layers are interlaced. Furthermore they also contain fully connected layers, with neuron integrating way more than 10^3 signals. The reasons that there aren't much more fully connected layers, is that this doesn't work. Actually, one of the key developments in NNs is architectural, minpools, ReLus, U-net. All are key for modern networks, all architectural.
- Roark66 4y agoI fail to see the significance of this "urging of caution". What's next? Will they tell us those are not really analog like neurons and are in fact using binary numbers in their calculations? O the horror! Who cares? Everyone knows ML models do not reflect the mechanics of how biological brains work at low level. The most obvious is that they use electricity, discrete numbers, much faster refresh rate etc. As a consequence the other low level "implementation details" will differ. The closer to "the hardware" the more differences there will be. I woukd be extremely surprised to see similar encoding, activation waves/patterns as in biological systems in ML for this reason, but also because how different the learning data and even the learning mechanism is. The brain has no backpropagation. However, there is deep similarity between both and IMO we are not far from AGI(decades at most). There is a measure of similarity between some advanced ML models (stable diffusion in visual, bloom in reasoning) and how our thinking works. This is especially visible when those things break or produce unexpected results in comparison with damaged/psychedelic human brain. Just like a human performing a math calculation and a computer performing the same calculation are doing essentially the same thing despite vastly different "implementation method", and same as computers helped us advance our understanding of mathematics(and physics etc) ML models will help us understand more about how our own thinking works. Just as there is something universal in an act of adding two numbers, there is something universal in an act of processing language to derive intent and carry out complex instructions. The crucial unknown however at this stage is whether our most advanced ML models are indeed using the same universal high level mechanisms we do to understand our input when they demonstrate their incredible capabilities or are they simply some advance method of compressing and searching through the training data? The first stage of answering this question is to determine if there is really a difference. Perhaps all we are, are databases doing an effective search algorithm over our training data? This is what science hopefully will answer in coming years. In one way the pace of incredible discoveries of those new and bigger models is not leaving the scientific community enough time to study those models fuly. I can imagine many lifetimes could be spent just studying bloom or stable diffusion, but how to do it when new models twice their size show up 6 months later? How to focus on one model and one application of it in this quickly changing environment?Still, I'm very grateful that I can see this progress during my lifetime. While growing up in the 90s I had this feeling of "missed opportunity" that I never saw nor I have taken any part in the computing revolution that happened before I was born, but this new AI revolution certainly makes up for that.
- 19h 4y agoWe've been doing significant research using HTM[1][2][3][4] w/ SDR[5] similar to the proprietary implementation of Semantic Folding[6] and were able to classify literally gigabytes of documents per second on FPGAs. HTM aims to resemble the architecture of the Neocortex. I simply don't understand why literally everyone immediately jumps at CNNs, RNNs (transformers et al.) -- they're extremely expensive, slow and definitely not usable for SIGINT-sized intel projects. [1] https://arxiv.org/pdf/2112.14820.pdf https://arxiv.org/pdf/2112.14820.pdf [2] https://arxiv.org/pdf/1402.2902.pdf https://arxiv.org/pdf/1402.2902.pdf [3] https://arxiv.org/pdf/1509.08255.pdf https://arxiv.org/pdf/1509.08255.pdf [4] https://arxiv.org/pdf/2205.15407.pdf https://arxiv.org/pdf/2205.15407.pdf [5] https://arxiv.org/pdf/1602.05925.pdf https://arxiv.org/pdf/1602.05925.pdf [6] https://arxiv.org/pdf/1511.08855.pdf https://arxiv.org/pdf/1511.08855.pdf
- deleted 4y ago[deleted]
- nl 4y ago> I simply don't understand why literally everyone immediately jumps at CNNs, RNNs (transformers et al.) -- they're extremely expensive, slow Because for text they work a lot better. HTMs are competitive with other non-NN techniques on small datasets (see [1] you listed) but nothing particularly amazing. I'd speculate this is because they use bag-of-word variants like LSI and TF-IDF. Prior to Transformers this was a competitive technique and you could get state-of-the-art results on most things using similar techniques. This representation of data matters a lot. Even just switching to a word embedding representation and using a SVM or something gives a decent gain in most circumstances. But transformers are much better, particularly on harder tasks (eg question answering on long documents). You can't really see how significant this difference is on these small datasets, but as an example BertGCN is getting over 89% accuracy (HTM in [1] gets 83%). It's possible (likely!) some of this gain is from the better representation Transformers use, not just the model. > definitely not usable for SIGINT-sized intel projects If SIGINT in this context means signal intelligence (on text data) then I assure you that they are being used. [1] https://arxiv.org/pdf/2112.14820.pdf https://arxiv.org/pdf/2112.14820.pdf [2] https://paperswithcode.com/paper/bertgcn-transductive-text-classification-by https://paperswithcode.com/paper/bertgcn-transductive-text-c...
- cockinablender 4y ago