5 ms·
Researchers create “neuromorphic chip” that is modeled after the brain
- cVwEq 9y agoTL;DR Researcher and team at Yale invent a chip that is similar to a neural network. It's good at object recognition and operates asynchronously.
- Exo_Tartarus 9y agoI wonder how that train it? The network is built into the silicon so I don't see how training could occur after its creation... But maybe they build a simulated network and train it then construct a faithful hardware representation
- aalleavitch 9y agoI honestly think that focusing on asynchronicity is almost completely the wrong way to go about designing neuromorphic systems. One thing that engineers almost never focus on, but is a well-researched vital aspect of the brain, is the concept of firing frequency and synchronicity: "cells that fire together wire together". This aspect of synchronized, timed firing is so strong that it creates neural oscillations on a large scale that are consistently characteristic of different brain states (brain waves) and widely theorized to be important to how information is encoded in the brain. It's also very commonly observed that, for instance, the intensity of a stimulus is encoded not in the amplitude of a particular neuron's response but rather in the frequency of a neuron's firing. This oscillatory activity has been shown to be active at all different levels of organization, too. There's basically an entire dimension to how the brain works (in terms of positively and negatively interfering wave patterns localized in different parts of the brain, with neurons that serve to speed up or slow down a continuous pattern of firing) that people looking to reproduce its function usually totally ignore. They think of neuronal firings as discrete calculations, when really they're transformations on an ongoing pattern of activity that's evolving over time. I feel this way of looking at the brain is far more consistent with how biological processes generally function: the point is not that each neuron is accomplishing some precise operation independent of the other neurons, but rather that with a large enough population of imprecise neurons firing individually an overall pattern of useful activity emerges.
- ianai 9y agoI think directly emulating the current understanding of biological systems isn’t necessarily the best way. It’s a losing proposition to emulate hardware with other hardware that’s fundamentally different from the original. I think the better way would be emulating what we understand of the ‘software’: memory, concepts, language/communication, etc. (I say that all with great humility. This is by no means a field I can speak about with authority.
- aalleavitch 9y agoThat's the problem, though: the idea behind a neuromorphic system is that it works like the brain, but what these "neuromorphic" chips do relies on an extremely vague relationship between a type of computing we know how to do (parallel processing), and what the brain actually does. Furthermore, I think that the type of deep learning that actually works well (like recurrent neural nets) relies more on these aspects of the brain (synchronized and oscillatory activity) than a lot of engineers working in the field realize as they chase after other concepts of how neurons might work. I feel like there's a lot of breakthroughs that could be made in the field of neuromorphic computing (and honestly in our understanding of how the brain works) if there were simply more people who were equally well-trained enough in neuroscience and computing to see the deeper relationships. As it is, I feel like the majority of experts that have deep knowledge in one of these fields are hampered by a superficial understanding of what's going on in the other. We're really only scratching the surface of how we could design a system that approximates what the brain does.
- arketyp 9y agoOut of curiousity given your seemingly strong sentiments, what is your background and what authors/researchers would you say have influenced your thinking the most?
- aalleavitch 9y agoI'm just a frontend engineer who dabbles in ML and cognitive science; my neuroscience experience is limited to a bachelor's degree and a couple years of lab work so I'm admittedly a lot more passionate than I am personally authoritative on the subject. The biggest influence on my thinking regarding intelligent systems generally is Douglas Hofstadter, but the notions of brain function I alluded to above are prevalent throughout a lot of computational neuroscience.
- GuiA 9y ago1 million “neurons” that communicate via 256 million “synapses.” Human brain = an estimated 100 billion neurons for over 100 trillion synapses according to Wikipedia So a 5 orders of magnitude difference for neuron count, but only 1 small order of magnitude for average synapse per neuron (1 for 256 in former, 1 for 1000 in latter) I wish scientific news were better at framing the numbers they quote from press release. It’s interesting to keep track of these sort of numbers, because while we clearly won’t have a chip that can do things remotely near what a human brain can when the numbers are at parity, at least it’ll help focus people more on exploring changes in architecture, rather than throwing more and more computational units at the problem.
- crusso 9y agowhile we clearly won’t have a chip that can do things remotely near what a human brain can when the numbers are at parity That seems hard to say at this point. Certainly quantity won't be the sole determining factor; but quantity combined with behavior and interactions might mean that on-a-chip neurons function better than human/animal brains.
- aoeusnth1 9y agoI find that neuromorphic chips are in this awkward valley where they aren’t trying to be state of the art machine learning systems (TPUs and GPUs do ML much better), but they’re also not trying to emulate biology faithfully. I think experimenting with new hardware and technologies is great, and I hope we discover something really useful from these. Still, I cant help but wonder whether they should be more focused in either practicality or pure science.
- mtgx 9y agoI guess one focus would be "extreme energy efficiency". Start from that point and solve the performance aspect later.
- crusso 9y agoBut there are people working on the pure science of learning how the brain works. Taking bits and pieces of strategies, chemicals, or structures found in nature and adapting them to other technologies has a long history of success. If I had some bitcoins to bet, I'd put them on these emulated brain/neuron-on-a-chip techniques when it comes to our pursuit of general purpose AI.
- rainingmonkey 9y agoA few years back, it seemed like neuromorphic chips were going to be the next big thing, especially in mobile chips given their low power usage. I recall seeing a clip of someone from Qualcomm talking about how they would be rolling out SOCs with their 'zeroth' line neuromorphic co-processor around 2014, but the tech in this article appears to be at the same level as it was back then. Could the tech have been kept secret for military purposes? Or is it more likely that neuromorphic chips are just difficult to get right?