15 ms·
Physicists are building neural networks out of vibrations, voltages and lasers
- dhon_ 4y agoThis reminds me of the method of calculating Fourier transform by refracting light through a prism and reading off the different frequencies. You get the "calculation" for free.
- nurettin 4y agoThis is solarpunk material.
- stackbutterflow 4y agoIs it calculation or simulation?
- deleted 4y ago[deleted]
- Banana699 4y agoNot much difference here, Calculation (or, more generally, Computation) is the manipulation of abstract symbols according to pure rules that may or may not represent concrete entities, e.g. the simplification of polynomials according to the rule of adding like powers. Simulation is when we manipulate things (concrete or abstract) according to the rules that govern other concrete things, e.g. pushing around balls in circles to (highly inaccurately) represent the orbit of planets around a star. Not all calculation is simulation, and not all simulation is calculation, but there exists an intersection of both. The key trick you can do with that last category is that when the physical system you're simulating is controllable enough, you can use the correspondence in the other direction: Use the concrete things to simulate the abstract things. It's simulation, because you're manipulating concrete entities according to the rules that govern other entities (who happen to be abstract),but what you're doing also amounts to doing a calculation with those abstract entities.
- Enginerrrd 4y agoAnalog computers are pretty awesome! Say you take a standard slide rule with two log scales, and want to do a division problem, x/y. There's more than one way to do it. I can think of at least 3. One of them won't just compute x/y for your particular x, but will compute x/y for ANY x. Accuracy is always the issue with analog stuff, but they sure are neat. Another fun one to contemplate is spaghetti sort. With an analog computer of sufficient resolution, you can sort n elements in O(n). You represent the numbers being sorted by lengths of spaghetti. Then you put them on the table straight up and bring a flat object down until it hits the first and largest piece of spaghetti. You set that down and repeat the process, selecting the largest element of the set every time. I've always liked the idea of hybrid systems. I envision one where you feed the analog part of your problem with a DAC, then get a really close answer up to the limit of your precision from the analog component, then pass that back out to an ADC and you have a very very close guess to feed into a digital algorithm to clean up the precision a bit. I bet you could absolutely fly through matrix multiplication that way. You could also take the analog output and adjust the scale so it's where it needs to be on the ambiguous parts, then feed it back into your analog computer again to refine your results.
- TedDoesntTalk 4y ago> spaghetti sort Isn’t this how very old sorting machines with punch cards worked? I’m thinking of the kinds used by the census or voting machines in the late 1800s or early 1900s.
- TremendousJudge 4y agoI think they used radix sort, which is also pretty cool
- hbarka 4y agoWhere does a doctor’s stethoscope fit in? Other examples: Mechanic’s stethoscope for diagnosing an engine, airplane vibrations to foretell maintenance, bump oscillations to grade quality of a roadway.
- teshier-A 4y agoSurprised to see no mention of LightOn and its Optical Processing Unit !
- V-2 4y agoThis perspective fits nicely with the simulation theory. If we accept it, for argument's sake, then what's happening is essentially delegating the computation to the ultra-meta-computer that runs the simulation.
- arrow7000 4y agoIt also fits nicely with the universe just being mathematically consistent
- V-2 4y agoThis misses the "computation" (being shifted from one layer to another) aspect though. Universe being mathematically consistent and being simulated are completely orthogonal concepts.
- arrow7000 4y agoI understood your comment to be an argument in favour of the simulation hypothesis. So my comment says that that doesn't work. On second reading though it seems like all you're proposing is a mental model for 'analog' computation; that it's like outsourcing the computation to a lower level of hardware. Then yes I agree with that.
- IIAOPSW 4y agoThe universe working on a computational principle no more entails it being a simulation than the previous "mechanics" based physics entails it being a machine. Its an unfortunate fact of language and history that it is hard to express the idea of "digital physics" without misleading people into a quasi-scientific secular form of Gnosticism (aka: this is the simulation, the real reality and motivations of the people behind it are hidden from us).
- V-2 4y agoYeah, I'm not advocating the simulation hypothesis as such : ) I'm only saying it fits here nicely as a thought experiment (that's why I emphasized: "for argument's sake"). Its actual correctness is beyond the point. As for the validity of simulation hypothesis itself, I'd say it's essentially religion in disguise*. It's unfalsifiable by definition too, and personally I apply Occam's razor on the idea, but obviously I can't disprove it. The question can't be "is it true", but it's fine to ask "is it a useful (or at least thought-provoking) metaphor?" (in a given context). ___ * Most religions, in my view, can be broken down to the sum of: a) simulation hypothesis of sorts (universe run by Creator), b) code of ethics with mnemonic narratives, c) ceremonies, that covers most of it analytically speaking.
- SilasX 4y agoLike how mirrors "compute" the (appropriately defined) reverse of an image?
- ulnarkressty 4y agoAn even better one - holding an image at the focal point of a lens produces its Fourier transform at the focal point on the other side of the lens[0]. It is used for "analog" pattern matching[1]. There is an interesting video explaining this on the Huygen Optics Youtube channel[2]. [0] - https://en.wikipedia.org/wiki/Fourier_optics https://en.wikipedia.org/wiki/Fourier_optics [1] - https://en.wikipedia.org/wiki/Optical_correlator https://en.wikipedia.org/wiki/Optical_correlator [2] - https://www.youtube.com/watch?v=Y9FZ4igNxNA https://www.youtube.com/watch?v=Y9FZ4igNxNA
- dhon_ 4y agoFascinating, thank you for sharing!
- alliao 4y agooh god, I can see it coming. elaborated analogue music player for a special price. it's using nothing but light. the fuzzy output will be it's feature; sought after by misdirected audiophiles...
- sshlocalhost98 4y agoThis is such an interesting way of computation. I watched analog way of computing neural networks by veritasium.
- mensetmanusman 4y agoHumans are the universe thinking for itself.
- ben_w 4y agoThis is more like “Surprise! Turns out panpsychism was the right answer all along!”
- lolive 4y agoOk. But then: - what is the question? - what is the answer?
- rgrs 4y agoyes
- ben_w 4y ago> what is the question? Is the simulation hypotheses more or less plausible? > what is the answer? Supren supren, suben suben, maldekstra dekstra, maldekstra dekstra, bee aye komenco. ;)
- porkphish 4y agoMagic 2.0?
- ben_w 4y agoJes, kvankam mi ankau povis paroli Esperanto antaue legi la libro (or rather, listened; audiobook), so when that line happened I recognised it even faster than Martin did.
- danbruc 4y agoIs the simulation hypotheses more or less plausible? It has always been implausible and it will most likely stay that way.
- rbn3 4y agoThis instantly reminded me of the paper "pattern recognition in a bucket"[0], which I've seen referenced a lot when I first started reading about AI in general. I only have surface-level knowledge about the field, but how exactly does what's described in the article differ from reservoir computing? (The article doesn't mention that term, so I assume there must be a difference) [0] https://www.researchgate.net/publication/221531443_Pattern_Recognition_in_a_Bucket https://www.researchgate.net/publication/221531443_Pattern_R...
- grahamrow 4y agoIn this PNN approach you are solving for what additional stimuli, when applied to the system alongside the inputs, produce the desired result for a given input. In reservoir computing (RC) you don’t bother to provide any additional stimuli, and find the linear combination of reservoir outputs that gives the desired result. Training the former is more demanding and analogous to a NN (thus the name), but directly produces your answer from the system. The latter is very easy to train (one regression) but requires post processing for inference.
- rbn3 4y agoaaah - got it, thanks!
- deleted 4y ago[deleted]
- reality_inspctr 4y agoBob Moog - who (basically) invented the synthesizer - was a passionate organic gardener. His belief system, in many ways, saw the two as similarly allowing humans to interface with the intelligence of the universe.
- TedDoesntTalk 4y ago> saw the two as similarly allowing I love bob moog, so can you explain this a little further? How is gardening a way to interface with the intelligence of the universe?
- rini17 4y agoNot any gardening but organic. There you don't impose your will onto the ecosystem ("the universe") but communicate with it, study how it solves problems and experiment and leverage it.
- RappingBoomer 4y agothe art and science of measurement is still quite an obstacle for us today...
- Agamus 4y agoData science is exposing the limits of the paradigm of individuation, on which mathematics is based. It is a flawed simulacrum of a fluxing universe which never stops changing, never solidifies into a value, a digit, an individual thing. Mathematics as a reflection of reality presumes that there is a pause button on the universe. This also explains why philosophy has made no substantial progress in the past few thousand years - it makes the same assumption in the idea of 'being', which is an impossibility for the same reason.
- zmgsabst 4y ago> Mathematics as a reflection of reality presumes that there is a pause button on the universe. This sounds more like your personal biases than a fact about mathematics.
- hans1729 4y agoI suppose the "as a reflection of reality" is the catch in that phrase. Is π built into the fabric of that which is absolute? Which statements are we able to make about axioms that hold outside of our reference frame?
- zmgsabst 4y agoPi describes relationships and outcomes we see in reality when actions are performed — and that abstract relation explains the commonality in many experiences. Eg, tossing match sticks relates to pi. https://www.youtube.com/watch?v=sJVivjuMfWA https://www.youtube.com/watch?v=sJVivjuMfWA
- mhh__ 4y agoI think data science suffers that more than mathematics does...
- lisper 4y agoA better title would have been: how to make the universe do (a whole lot of) math for us [1]. What so-called neural networks do should not be confused with thinking, at least not yet. And the fact that we can get the universe to do math for us should not be surprising: we can model the universe with math, so of course that mapping works in the other direction as well. And this is not news. There were analog computers long before there were digital ones. --- [1] ... using surprisingly small amounts of hardware relative to what a digital computer would require for certain kinds of computations that turn out to be kind of interesting and useful in specific domains. But that's not nearly as catchy as the original.
- misja111 4y ago> we can model the universe with math, so of course that mapping works in the other direction as well. This is not so obvious as you make it appear. For instance, we can model the weather for the next couple of days using math. But letting the weather of the next couple of days calculate math for us doesn't work very well. The reason is that we can't set the inputs for the weather. This problem comes up in various forms and shapes in other 'nature computers' as well. Quantum computers are another example where the model works brilliantly but setting the pre- and side conditions in the real world is a major headache.
- lisper 4y agoI didn’t mean to imply that implementing it should be easy. Only that it should be unsurprising that it is possible.
- goldenkey 4y agoYou can use the weather or a bucket of water or well, any sufficiently complex chaotic system, as a reservoir computer though: https://en.wikipedia.org/wiki/Reservoir_computing https://en.wikipedia.org/wiki/Reservoir_computing
- yetihehe 4y agoReservoir computing still needs to provide input. How do you input into weather? And if you find that you indeed can provide inputs to weather, you should ask if you should provide inputs into weather. Using weather as a computer might simply be unethical and could get you killed (after some angry farmers come knocking on your lab door because you ruined their harvest).
- pseudolus 4y agoI believe one of the earliest applications incorporating this line of thought was MONIAC, the Monetary National Income Analogue Computer, which used water levels to model the economy [0]. There's a short youtube documentary on its history and operation. [1] [0] https://en.wikipedia.org/wiki/MONIAC https://en.wikipedia.org/wiki/MONIAC [1] https://www.youtube.com/watch?v=rAZavOcEnLg&ab_channel=ReserveBankofNewZealand https://www.youtube.com/watch?v=rAZavOcEnLg&ab_channel=Reser... https://youtu.be/rAZavOcEnLg?t=101 https://youtu.be/rAZavOcEnLg?t=101 (shows operation of MONIAC)
- wardedVibe 4y agoAnalog computers are from the 19th century; they were used to decompose signals using the Fourier transform, since it's easy(ish) to get a bunch of different frequency oscillators. They used them for tides and differential equations. https://en.m.wikipedia.org/wiki/Analog_computer https://en.m.wikipedia.org/wiki/Analog_computer
- cpdean 4y agoAfter-all, we tricked sand into thinking for us so it makes sense that certain applications could run on other mediums.
- discreteevent 4y agoWhen I first came across machine learning it reminded me of control theory. And sure enough if you search around you get to articles like this [1] saying that neural networks were very much inspired by control theory. The bit of control theory that I was taught way back was about analog systems. I have no idea if the electronic circuit mentioned at the end is even like a classical control system but it does feel a bit like something coming around full circle. [1] https://scriptedonachip.com/ml-control https://scriptedonachip.com/ml-control
- momenti 4y agoI wonder what kind of speedup can we expect from neuromorphic computing within the next 5-10 years?
- EricBurnett 4y agoI've long been enamored with the idea of learning from analog computers to build the next generation of digital ones. In some perspective all our computers are analog, of a sort - today's computer chips are effectively leveraging electron flow through a carefully arranged metal/silicon substrate, with self-interference via electromagnetic fields used to construct transistors and build up higher order logic units. We're now working on photonic computers, presumably with some new property leading to self interference, and allowing transistors/logic above that. "Wires" are a useful convenience in the electron world, to build pathways that don't degrade with the passing of the elections themselves. But if we relax that constraint a bit, are there other ways we can build up arrangements of "organized flow" sufficient to have logic units arise? E.g. imagine pressure waves in a fluid -filled container, with mini barriers throughout defining the possible flow arrangement that allows for interesting self-reflections. Or way further out, could we use gravitational waves through some dense substance with carefully arranged holes, self-interfering via their effect on space-time, to do computations for us? And maybe before we get there, is there a way we could capitalize on the strong or weak nuclear force to "arrange" higher frequency logical computations to happen? Physics permits all sorts of interactions, and we only really use the simple/easy-to-conceptualize ones as yet, which I hope and believe leaves lots more for us to grow into yet :).
- sandworm101 4y agoElectricity is also a wave. The wires are essentially waveguides for particles/waves traveling at near luminal speeds. So in theory anything done with electricity could be replicated using other waves, but to make it faster you would need waves that travel faster than electrons through a wire. Photons through a vacuum might be marginally faster, but pressure waves though a fluid would not. If bitflips are a problem in a modern chip, imagine the number of problems if your computer ran on gravity waves. The background hum of billions of star collisions cannot be blocked out with grounded tinfoil. There is no concept of a faraday cage for gravity waves.
- lupire 4y agoGravity is a poor source of computation because it is incredibly weak - 10^-43 vs electron force. Even if you add several powers of 10 for all the metal wire harness and battery chemistry around the electrons, you still get far more usable force per gram from electricity and metal than you do from gravity.
- reality_inspctr 4y agobut what does the universe think of us? --my friend on signal
- schmeckleberg 4y agowell, we haven't been gamma ray burst'd yet. sheepish thumbs up
- mrtesthah 4y agoHuman thought is the universe thinking. Life, inclusive of humanity, is contiguous with deterministic physical reality.
- akomtu 4y agoThat's buddhist fundamentalism: the entirety of existence is one "I" that made up the rules of "matter" on one side, the many small "I" players on the other side, and plays by those made up rules to discover itself. Something like a whiteboard chess game with one player playing both sides.
- toss1 4y agoThe subheader: >>Physicists are building neural networks out of vibrations, voltages and lasers, arguing that the future of computing lies in exploiting the universe’s complex physical behaviors. I.e., analog can do insane levels computing (it's had 13+ billion years to evolve, but digital computing is easier to think about, so, like the hapless drunkard looking for his lost key under the streetlight because it'll be easier to see (instead of where he most likely dropped it), we pursue digital because it's easier to reason about. TBF, digital does yield bigger results much more quickly and flexibly, but some really interesting problems will likely require further exploration of the analog computing space.
- kingkawn 4y agomakes ya wonder what sorts of computing was done by the ancients with the natural materials they had available.
- willhinsa 4y agoThe universe is already thinking for itself! It wrote this comment and built this website, after all.
- tabtab 4y agoAnd trying to expel humans after seeing them in action.
- shadowgovt 4y agoThis is why real computer science is pencil-and-paper work, not a sub-field of electronics. Electronics is great because we can create some specific fast, reproducible physical phenomena with it (logic gates, symbol storage and retrieval). But any physical principle that can create fast, reproducible phenomena would be just as valuable for computing. Diamond Age posits smart-books that operate on atomic-scale "rod logic" mechanical phenomena. Cells do something that looks an awful lot like computation with protein chemistry.
- photochemsyn 4y agoReads like science fiction becoming reality. In particular, the science fiction series by Hannu Rajaniemi (Quantum Thief, Fractal Prince, Causal Angel) has 'natural computational substrates' as one of its themes. This all seems to exist on the borderland between discrete and continuous mathematics, which is a pretty fascinating topic. Digital systems rely on discrete mathematics, while things like fluid dynamics are much more in the world of continuous smooth functions. It seems as if they're really building an interface between the two concepts.
- alach11 4y agoIndeed. This is straight out of Permutation City by Greg Egan.
- dane-pgp 4y agoI'm reminded of the Church–Turing–Deutsch principle[0] which states that a universal computing device can simulate every physical process. Putting that another way, I think it means that anything that can happen in the universe can be modelled by sets of equations (which we might not have yet) which can be calculated on a universal Turing machine. There is the question of what can quantum computers do polynomially or exponentially faster than a classical computer, but I think it's accepted that all quantum computations can be achieved classically if you don't mind waiting. [0] https://en.wikipedia.org/wiki/Church%E2%80%93Turing%E2%80%93Deutsch_principle https://en.wikipedia.org/wiki/Church%E2%80%93Turing%E2%80%93...
- Hedepig 4y agohttps://xkcd.com/505/ https://xkcd.com/505/
- subless 4y agoWell Tesla did say and I quote “If you want to find the secrets of the universe, think in terms of energy, frequency and vibration.” AND “The day science begins to study non-physical phenomena, it will make more progress in one decade than in all the previous centuries of its existence.” I think we’ll make great progress if we eat those words.
- FredPret 4y agoI wonder if we’ll end up with a hyper-intelligent shade of the colour blue
- inasio 4y agoRelevant: DARPA last year launched a program (competition) to build analog solvers that can solve (some) optimization problems [0]: [0]: https://www.darpa.mil/news-events/2021-10-04 https://www.darpa.mil/news-events/2021-10-04
- mattwilsonn888 4y agoAnalog computers: why simulate interactions between real numbers digitally when you can just do it physically?
- 1970-01-01 4y agoThis reminded me of the Boltzmann brain. https://en.wikipedia.org/wiki/Boltzmann_brain https://en.wikipedia.org/wiki/Boltzmann_brain
- NHQ 4y ago>To this end, they built a self-learning circuit, in which variable resistors act as the synaptic weights Hey where did they get memresistors?
- dukeofdoom 4y agoI remember watching "The Price is Right" as a kid, and seeing a Planko type game where the contestant releases a round puck at the top of the board that then bounces off of metal pegs to land at a number down below. It seemed to me if the puck was of metal, and the pegs could be magnetized with current, you could influence the probability where the puck landed. A sort of simplistic neural network could be made by varying the charges until the puck landed at the desired position.
- jillesvangurp 4y agohttps://mythic.ai/ https://mythic.ai/ These guys have built a neural processor based on analog computers. I think, they adapted the circuitry that is also used for SSDs to emulate multiplication. The main advantage they cite relative to using a GPU is vastly less power used.
- beambot 4y agoGreat Veritasium video on YouTube about analog neuromorphic architectures and their promise for lower-power operations: https://www.youtube.com/watch?v=GVsUOuSjvcg&t=1s https://www.youtube.com/watch?v=GVsUOuSjvcg&t=1s
- sshlocalhost98 4y agoYup just watched it.
- jillesvangurp 4y agoI should have quoted that; thanks for that.
- qwerty456127 4y agoI once read about a theory of mechanical interactions being at least equally (or more) important than electric in human brains.
- thow34wqway 4y agoWhat is the size of the parameters used in the computer? Does the vibration changes change during training or only the parameters?
- akeck 4y agoThis reminds me of BEAM bots. https://en.m.wikipedia.org/wiki/BEAM_robotics https://en.m.wikipedia.org/wiki/BEAM_robotics