6 ms·
A little thing I realize upon reading about all the brain study is how bad we are at reverse engineering a totally alien "computer". In popular media, human is
by tomohelix 2y ago
A little thing I realize upon reading about all the brain study is how bad we are at reverse engineering a totally alien "computer".
In popular media, human is often depicted as some super scavenger that can exploit and adapt alien technology to their own in a matter of 1-2 lifetimes. And yet here we are in reality, after thousands of years with abundant and intimate access to one of the most efficient and most capable information processor known to us, and we are still absolutely clueless about how it work.
The closest thing we built to mimic it cost maybe a million times more energy and perform a fraction of the functions of the original one. So much for "reverse engineering".
- jl6 2y agoIf you are comparing the energy cost of LLMs, consider that the "training cost" of the human brain is the accumulated evolutionary activity of the last 4 billion years. Human inference is much more efficient though - we run at about 100 Watts[0], probably a lot less for the thinking alone. [0] https://physics.stackexchange.com/questions/431522/humans-have-an-average-energy-budget-of-100-watts-but-the-power-radiated-from https://physics.stackexchange.com/questions/431522/humans-ha...
- ben_w 2y agoGiven I can do token generation on a 30 watt laptop, the language/Joule part at least seems to be the computer winning. (Separate to any discussion about quality). Not so for images, as I can imagine visual scenes in what feels like real time, while even the fastest image generator I've seen was 200-300 ms at 512x512.
- ant6n 2y agoI doubt your imagination runs at a full 500x500 resolution.
- ben_w 2y agoI have no idea at which level of processing in which of my brain's visual areas my visual imagination is generated, however I can say that the subjective experience is "retina resolution".
- stvltvs 2y agoBased on my own experience, it's only high resolution because when I focus on an area my mind generates the details. Until then, it's all broad strokes. JIT image generation in other words.
- deleted 2y ago[deleted]
- DiggyJohnson 2y agoWell said, this precisely matches my experience. I can imagine and visualize scenes in real-time, but it's not like looking at landscape photography.
- callalex 2y agoComputers can do this too! It’s called “foveated rendering”.
- ramblenode 2y agoImagination has been found to activate the same V1 cortex that vision does. The V1 cortex is retinotopic, so individual neurons (or at most small groups) act like pixels. There are approximately 280 million V1 neurons, so the neuroanatomical resolution of the visual cortex is much greater than 500x500. This may not be the resolution we perceive as we imagine, but perception involves many additional systems and bottlenecks (notably, one can train oneself to have a more acute imagination, and there are people who report their imagination to be as acute as their vision).
- tomohelix 2y agoI mean, a bunch of rocks falling on a keyboard can also generate tokens. So can an autocomplete software running on a 10W phone. But the quality is so far apart to the point you would find most people do not consider them on the same categories of "inference" as an LLM, not to mention a real human's mental capacity.
- mewpmewp2 2y agoBy the way, rocks falling is potential energy turned to kinetic energy so it is quite a lot of energy used. Didn't fact check this but if you drop 10 100g rocks per second from 2m height it is 30w according to GPT. Although I guess you could use one rock fall to generate A LOT of tokens if you don't use keyboard, but just use the variance data from falling rock to generate many tokens at once.
- hackerlight 2y agoYou're not really imagining visual scenes, the resolution just isn't there if you think about it. It's more like you're imagining low resolution encodings, which is definitely the smart and efficient way of doing it that evolution would choose over a wasteful full sim.
- ben_w 2y agoEncodings perhaps, but I assure you the subjective experience of the resolution is indistinguishable from my eyeballs.
- DiggyJohnson 2y agoIt sounds like you're subjective experience of visualization is wildly different than the average, then. I think I have an excellent imagination and visualization ability, but it doesn't compare to just looking out my eyeballs in terms of resolution or cognitive load.
- zdp7 2y agoLook up aphantasia on https://en.wikipedia.org/wiki/Aphantasia https://en.wikipedia.org/wiki/Aphantasia they have a sidebar describing the spectrum of the ability to visualize images. The highest level is considered photographic. The other side is the inability to visualize anything.
- mewpmewp2 2y agoOkay I surely must have aphantasia then if you are describing seeing images like that.
- freilanzer 2y agoSame, imagining objects feels like a fever dream for me, with illogical and warped proportions.
- ben_w 2y agoFor me, the only visual parts of a dream that have ever been wrong like that, has been text — but the last time I recall dreaming of text was the late 90s, so I don't know if that's still the case. Odours are a thing I can't "visualise", and those are usually entirely absent from my dreams.
- piva00 2y agoFrom the 100W consumed by the brain most of it is to keep the autonomic functions (respiratory, cardiac, digestion, processing senses [eyesight, hearing, touch, etc.]), actual thinking, executive function, language processing, etc. is a small percentage of the 100W in use.
- ben_w 2y agoYes, 20 watts or so for just the brain. But those 30 watts on the laptop also cover the screen, hard drive, wifi, etc. If you want to count the brain alone, then it must be compared with just the silicon alone; if you want to count the whole body, then it must be compared with the whole machine.
- postalrat 2y agoSounds fair if the laptop is capable of most of what the body can do an vice versa. Maybe fair when we have bipedal robots doing work for us.
- ben_w 2y agoDepends what you want with the thing. If the question is "I want to get this much mental stuff done", then you need the brain and the cost of keeping the brain alive and connected to the outside world — which for a human brain is the body, and for a silicon "brain" the computer/network. If you want a humanoid robot to do be a drop-in replacement for human labourers in all professions, then sure (modulo the open question of how much brain power all our jobs actually require) a whole robot body has to be ready and you need to compare that body to our body. If you want a special purpose machine that fully automates one specific product line but doesn't need to move, the "brain" might just be punched cards: https://en.wikipedia.org/wiki/Jacquard_machine https://en.wikipedia.org/wiki/Jacquard_machine
- HenryBemis 2y ago> 4 billion years Well the computers/CPUs haven't been evolving for a few million years (https://en.wikipedia.org/wiki/Timeline_of_human_evolution); https://en.wikipedia.org/wiki/Timeline_of_human_evolution); let's assume from Mammals onwards. If a CPU has been developed so much within a few decades, then with the capabilities provided on ML/LLM/AI/and other-such-acronyms, in a million years we should at least have a "Lucy" (https://www.imdb.com/title/tt2872732/ https://www.imdb.com/title/tt2872732/) evolved. In the meantime, I expect that in a few hundred years we will have a Borg Queen (perhaps without the interconnectivity).
- zdp7 2y agoRemember, though that LLMs also need the accumulated evolutionary activity. They're not that interesting if you don't feed them human created content. Contrast that with the human computer that builds itself and then infers language and complicated physical and mental tasks.
- trueismywork 2y agoNot really. We had millions (and now trillions) of copies of brain feeding each other.
- monkeydreams 2y agoSo who trained the first brain and what was the costs?
- Citizen_Lame 2y agoBig bang. Imagine the energy.
- EPWN3D 2y agoFortunately for us, we've prioritized medical ethics over reverse engineering.
- BobaFloutist 2y agoPart of the problem is that it's not really possible or ethical to truly observe and tinker with it while it's running. I doubt we would have similar ethics concerns with a non-sapient alien computer, though we might have a more limited number of examples.
- jijijijij 2y agoWe don't know how brains of our lab animals work either. We literally throw millions of chickens into meat shredders alive, daily. I don't think it's an ethics issue.
- BobaFloutist 2y agoLabs have higher (legally enforced) ethics standards than farms. And regardless, vivisection is pretty obviously more painful and less ethical than culling.
- huppeldepup 2y agocan a computer be complex enough to comprehend its own complexity?
- Andrews54757 2y agoBiological systems are not "engineered" in the same way a computer is. Computer chips, despite all their complexity, are designed to be understood by humans - they are modular, and abstract-able to facilitate design. Biological systems do not have these properties unless it is advantageous for the task at hand. You often have systems where everything interacts with everything else in meaningful ways. So it isn't really accurate to directly compare reverse engineering technology to reverse "engineering" nature
- eddd-ddde 2y agoI don't think the point of engineering is for something to be understood. Biological systems, _solve_ real problems. They adapt. That's very much engineering in my opinion. That most of our engineering is designed to be understood is just a side effect of how humans do things, not an inherent property.