8 ms·
Artificial synapses 10k times faster than real thing
- palad1n 4y agoBut is that the point of artificial "neurons", to mimic the functioning of actual neurons? I'm certain we don't have a complete model of how the natural neurons function.
- qualudeheart 4y agoHow soon till we can use these in production? How much better will they be from normal compute?
- sdenton4 4y agoYou don't want to use artificial neurons in production... All the biomimetic ML lags vastly behind core ML research.
- tsimionescu 4y agoThere's nothing biomimetic about this, anymore than a regular ANN. It is a way to encode a "neuron" from the ANN in hardware, instead of running it in sofware.
- kadoban 4y agoWouldn't the real comparison be against common, existing, digital implementations?
- pizzathyme 4y agoI read other research recently that showed that real synapsis have additional dimensions of data that are stored than previously thought. Whereas before it was thought they were a simple binary fire/no fire, they are also transferring data through width and height of the firing. Because of this neural networks designs may be missing a key feature.
- stephenhuey 4y agoFascinating! Any idea where you came across this?
- nonameiguess 4y agoIt's not exactly a "new" finding that neurons communicate signals to each other by means other than purely electrical signalling. The existence of well over 100 different neurotransmitters has been known for some time, and these are used to create unique signal cascades within the receiving neuron depending on the exact concentration sent. There is nothing equivalent to this in artificial neural networks. Artificial neural networks are not necessarily using binary neurons. Each activation unit may receive and pass on a continuous signal, but this tends to be a single floating-point number, usually normalized to be between -1 and 1 or between 0 and 1. Biological neurons are sending at minimum hundreds of these continuous-valued signals to each other. Likely, the closest way to build an equivalent artificial neural network would to have each neuron have hundreds of connections to all the other neurons it is connected to, rather than just one, but even that isn't necessarily equivalent, as what actually happens internal to the cells in response to these signal cascades isn't all that well-understood, but it involves quite a bit more than just determining what sort of signal to pass on to the next synapse.
- thrown_22 4y agoThat has never been thought by anyone but computer scientists who never looked at a biology textbook. To begin approximating what a lone spherical synapse would actually do you'd need to solve 2^n coupled second order differential equations where n is the number of ions used. That is before you throw in things like neuro transmitters and the physical volume of a cell. Simulating a single neuron accurately is beyond any super computer today. The question is how inaccurately can we simulate one and still get meaningful answers. Then how we do it 100e9 more times.
- nawgz 4y agoA poor facsimile runs faster due to being greatly simplified? Colour me pineapples
- kadoban 4y agoIt's probably also because evolution didn't have to make it out of meat and goo. But ya that also helps. > Colour me pineapples That's a nice phrase, I like it.
- Barrin92 4y agoGod I wish people would stop using the term "artificial" when they mean "metaphorical". An artificial organ is artificial if you can put it in the place where the original thing used to be, and it works. That's to say, it's equivalent in function. These 'synapses' aren't actually synapses and they don't emulate even a fraction of the processes you find in their biological namesakes.
- sjtgraham 4y agoArtificial just means made by humans.
- btilly 4y agoThe point is that these are inspired by human synapses, but nowhere near equivalent to them. They do something much simpler. Comparing them with human synapses is like comparing cellphones to servers. Not exactly apples to apples.
- WhitneyLand 4y agoAs the core part of some software I could make a game engine. Or I could do the same thing but name it an “artificial heart”, noting that it’s 10,000 times faster than a human heart. That makes sense because artificial just means made by humans?
- myownpetard 4y agoIt's more like calling an articulated robot with a manipulator a 'robotic arm', despite being infinitely simpler than a human arm and with much more limited functionality. I agree that the speed comparison seems like a very misguided metric though.
- tiagod 4y agoWell, it's a robot in the shape of an arm. A robotic dog doesn't have to look or behave much like a dog to earn its name. You wouldn't call them artificial dogs nor artificial arms (unless they were being used as a prosthetic I guess, but then it's just a robotic prostethic arm)
- larsiusprime 4y agoHeadline: New "artificial car" travels 30 times faster than the real thing and can fly! Thing they're describing: a bullet fired from a gun
- asah 4y agosorry for the downvote, but an essential function of a car is transportation - bullets don't transport anything (not even small things).
- tsimionescu 4y agoYes, and similarly, a memristor is not a neuron - it only bears a passing resemblance, probably worse than the resemblance between a car and a bullet.
- Majestic121 4y agoYou're talking about essence, the parent is talking about function. A horse is not a car, it does not even bear a passing resemblance, and yet both can be used as a mean of transportation.
- rbanffy 4y agoIt doesn't have to be, but both are, at some level of abstraction, switches that integrate multiple weighted inputs and set an output level that's used as input for other switches. If this is what we expect, the analogy holds and the implementation details don't matter.
- tsimionescu 4y agoBut there is a fundamental difference that breaks the analogy: the "function" that the neuron uses to set its output based on its input is not a function at all, it is a stateful mechanism. That is, for the same input at different times, a real neuron will have different outputs; and its own ouptus may change its state. In contrast, the memristor, once programmed, always applies the same function to its inputs. Even if it can be reprogrammed with a different weighting, it can't do so based on its own output - at least not with any current neural network architechture.
- deleted 4y ago[deleted]
- m3kw9 4y agoLast I heard they are still discovering new things about how human synapses work.
- teslaberry 4y ago
- brian_herman 4y agoWhen ever someone comes up with a new resistor type they seem to ignore all the research and development done with nand memory and regular cpu architectures. Like the memresistor all of the research and development done with nand flash and 5nm technology outweighs all these new types of gates.
- seydor 4y agoThese are ... not the synapses you 're looking for. These are resistors. It doesn't seem they can be used to replace weights in hypothetical deep learning circuits. They certainly can't replace real synapses
- dqpb 4y ago> The new programmable resistors are similar to memristors, or memory resistors. Both kinds of devices are essentially electric switches that can remember which state they were toggled to after their power is turned off. As such, they resemble synapses, whose electrical conductivity strengthens or weakens depending on how much electrical charge has passed through them in the past.
- seydor 4y ago... In the same way I resemble Brad Pitt If synapses worked like that we d all be epileptic, or dead
- deleted 4y ago[deleted]
- wilonth 4y agoBreaking news: website which displays "Hello World" runs faster than Google.
- FounderBurr 4y agoIs IEEE really so pathetically desperate for money they need to show layers and layers of ads on their articles? Sad.
- kypro 4y agoAlso, artificial synapses 10k times similar than real thing
- transfire 4y agoWell another science fiction staple becomes reality. This sounds very much like a “positronic brain”.
- xor99 4y agoWhat are the main differences between programmable resistors and varistors or photoresistors? I guess presence of volatile/non-volatile memory, smaller scale size and maybe lower voltage operation (e.g. compared to varistors)?
- soumendrak 4y agoBut, do we know the speed of the natural thing?