7 ms·
The brain simulates actions and their consequences during REM sleep
- ziofill 2y agoSo… it’s training itself on synthetic data?
- kridsdale3 2y agoThats what imagination is.
- calf 2y agoThen it must be really efficient amount of data since we only get like 7 dreams a night
- justinl33 2y agothe biological grok
- npollock 2y agorunning inference
- lokimedes 2y agoI thought this was already understood? Are anyone working on an analogous way of integrating reinforcement learning into training generative models based on what they have experienced in user interactions? Seems like having models “dream” e.g. do hypothesis testing and correct the weights based on the results could be a way out of the lack of enough training data.
- calf 2y agoThe mainstream info is predominantly that dreams are basically nonsense content (e.g. people dream they can fly) when executive functions are turned off and brain is doing garbage collection and memory consolidation, whereas this title argues the brain is nevertheless learning causal information from dreams which would suggest a more active role than previously thought.
- fluoridation 2y agoI'm with the GP, I thought I had heard this somewhere before. Also, I don't think both propositions are in conflict. Dreams may be meaningless and the brain may be using them for something.
- RoyalHenOil 2y agoMy hunch (based on my personal experiences) is that these occur in different phases of sleep. I find that while I am falling asleep, I often have indescribable nonsense "hallucinations" (I hesitate to call them that because it makes them sound a lot more cohesive than they really are) that feel almost like random noise. These are not just sensory hallucinations, but also logical hallucinations: I have thoughts and beliefs that make so little rational sense that I don't know how to describe them. But later on I will have complex dreams with coherent characters, plots, etc., and have an inner sense of logic (even though it is dream logic) that I can describe after I wake up.
- 486sx33 2y agoWith regard to your “hallucinations” comment, you remind me of something the old hippies told me. I remember asking about acid flashbacks and the heavy users would say oh yes we get flashbacks and I’d ask them lots of questions, eventually I established with them that the most likely time to experience as flashback is falling asleep or waking up from an afternoon nap.
- anal_reactor 2y agoOn a very rare occasion my brain gets stuck for a few minutes in the state between sleep and consciousness and this kinda does feel like acid.
- crazydoggers 2y agoHallucinations and lucid dreams during falling asleep are called hypnagogia and definitely are different as they don’t involve REM. I think a lot of people don’t talk about it for fear of sounding crazy. https://en.m.wikipedia.org/wiki/Hypnagogia https://en.m.wikipedia.org/wiki/Hypnagogia And for those interested In hallucinations, Oliver Sacks has an amazing book that I think also destigmatizes them and covers how different they can be from hypnagogic, to migraine, to drug induced, etc. https://en.m.wikipedia.org/wiki/Hallucinations_(book) https://en.m.wikipedia.org/wiki/Hallucinations_(book)
- jonnycomputer 2y agoI think in RL engineering circles offline, off-policy, generative experience replay is. In neuroscience, the idea is being actively explored, but it isn't a consensus position.
- relyks 2y agoI wonder if this can apply to humans for situations that either resolve conflict or to anticipate future events more effectively? People are known to process traumatic memories from the past during REM sleep by essentially reliving the experience and they're known to work through potential future events e.g. business executives have simulated meetings in their dreams for ones they anticipate to happen soon in the future.
- aib 2y agoSo: "Sleep on it" is an effective strategy.
- qwerty456127 2y agoWhy does my brain have to simulate so much of weird and stressful bullshit adventures which can never happen IRL? If it mostly is concerned about how to move the limbs then why I never remember actually using my body to do anything in a dream except the sensation I invoke to fly? To me it feels like my dreaming brain is mostly simulating emotional experiences.
- ugh123 2y agoDuring sleep the brain might be constantly simulating past experiences, movement, and altered consequences as a possible "re-training" model. Some of those simulations may have outsized emotional moments which "jolt" our consciousness enough to perceive the dream. Painful memories are often an easy target for these simulations to use because they have more definition that many other memories.
- RoyalHenOil 2y agoThese unrealistic adventures may not be for training you how to deal with unrealistic adventures. These dreams could be serving a much lower-level purpose: training your brain's deeper inner workings that you do not have direct conscious access to. Flying may help with fine tuning visual-spatial processing, for example.
- usrusr 2y agoyeah, it's never really flying for me, but lots of navigating across fantasy landscapes in odd modes of transport like chairlifts and ski runs. But the perception of those landscapes is very much including bird's eye view, only that it's never "me" at the elevated camera position. Whatever story happens, it simply isn't told exclusively through "subjective camera". (does dreaming even involve first person view? I think it's more like a faux awareness of being somewhere than faux vision) It's not flying to me, more like being able to "feel a map projection". But that's certainly close to flying, I guess it's the same category of dream from a "why" standpoint. And once the "i can fly!" part of off the table, I think the "why" is rather obvious: get used to thinking in larger topologies than what we encounter in sedentary day to day life.
- 2y ago
- justinl33 2y agoThis reminds me of an experiment in grad school on spatial memory in rats. We noticed that during sleep their hippocampal place cells would fire in a way similar to those seen during maze navigation. I personally experience this all the time, if I've been programming all day, I will be in a 'dream-like' state within the program
- roca 2y agoMakes sense to me. I organise a lot of hiking trips and I frequently have dreams where one of my trips has gone wrong and I'm trying to cope. It's a cheap way to simulate a problematic situation.
- ugh123 2y agoOnly read the abstract, but I wonder if some consequence to this field of research leads to our ability to control movement in dreams using some kind of external rf. The "control" might not be crisp without a visual component, but even having some ability to issue commands would be incredible.
- sholladay 2y agoI hope that nothing external can control my dreams. You can control your own dreams by practicing lucid dreaming.
- ronsor 2y agoWe know the end-game of such technology would be to serve ads to you while you're sleeping.
- amelius 2y agoHow do we know ads do not influence our dreams already?
- wsintra2022 2y agoThey do, Coca Cola been in my dreams before as product placement.
- ronsor 2y agoMaybe they do, but at least Google isn't charging for dream impressions yet.
- walterbell 2y agohttps://x.com/propheticai/status/1803811493881798701 https://x.com/propheticai/status/1803811493881798701 & http://bit.ly/3WumKvu http://bit.ly/3WumKvu Prophetic is developing a non-invasive neuromodulatory wearable. The device uses various “reading” neurotechnologies— including EEG and fNIRS, as well as a “writing” neurotechnology— transcranial focused ultrasound (tFUS). Our aim is to develop a viable neuromodulatory brain-computer interface for consumer use that is 1) closed-loop, 2) non-invasive, and 3) possesses a temporospatial resolution meaningful enough to induce discrete states of consciousness—such as lucid dreaming—with precision.
- hereme888 2y agoI've had plenty of dreams where I woke up thinking "I definitely won't do that."
- behringer 2y agoDefinitely. I think a lot of deja vu and deja reve moments are actually these simulations happening at night.
- gkhartman 2y agoI've often thought this was the case. Tangentially, when I don't get enough sleep, and my executive function is impaired, I tend to drift into involuntary daydreams. The content of those daydreams trends to feel like simulations of future events and possible outcomes. I can't say it's related, but I often wondered if my brain is saying "If your not going to sleep enough, so be it, I'll try to squeeze in some simulation tasks during the day". When I was a teen, I'd daydream about skateboarding. It could feel so realistic that I could get a "jump scare" in imagined situations that ended in me hitting the ground.
- phantompeace 2y agoYou’ve succinctly described what happens to me when I don’t sleep too well, even down the sudden jump scare when something happens in the day dream
- auc 2y agoYou might be microsleeping https://www.cdc.gov/niosh/work-hour-training-for-nurses/longhours/mod3/03.html#:~:text=The%20human%20brain%20can%20respond,Thus%2C%20lapses%20in%20attention%20occur https://www.cdc.gov/niosh/work-hour-training-for-nurses/long.... “The human brain can respond to sleep deprivation by reducing alertness and generating microsleeps – involuntary episodes of sleep lasting a few seconds. During microsleep, you may appear to be awake (eyes open), but your brain will not process information. Thus, lapses in attention occur.“
- BLKNSLVR 2y agoI seem to have microsleep trigger when my wife is telling me we've got something planned in three months' time. In three months minus one day, she'll let me know (again) and, damn if it's not the first I'd heard of that, and damn if my reaction doesn't cause an argument.
- exe34 2y agoit's really weird when they start conversations by saying "you weren't listening to me, were you?"
- swalsh 2y agoThis would explain why the answers to some of the hardest issues i've worked on seem to come to me after I wake up.
- juunpp 2y agoHammock-driven development is a thing: https://www.youtube.com/watch?v=f84n5oFoZBc https://www.youtube.com/watch?v=f84n5oFoZBc I think anyone can experience this even if you're unaware of the science behind it. The brain during sleep can also connect seemingly disconnected things in ways that your daily logical process would have a lot of trouble with. That's why things seem to "click" when you wake up from sleep. If your daily thinking is a gradient descent, your sleep thinking is a flood from all points and in all directions. But I don't have any science refs on this; just my experience.
- fy20 2y agoIn my last role I was working remotely, and almost every day after lunch I'd have a nap on the sofa for 20 minutes with the cat. In that role I felt the most productive I've ever been, and I suspect it is this habit that made it so. During this time I'd often come up with solutions or new ideas to problems. Now I work in office, and even if it was socially acceptable to nap after lunch, there is no sofa or cat.
- BLKNSLVR 2y agoSleep is quantum problem solving mode?
- adrian_b 2y agoWhile I have complex dreams, they seem completely unrelated to anything that I was thinking about during the previous day, in any case completely unrelated to any professional problems. Despite that, it is extremely frequent that in the very instant when I become awake in the morning I am aware of a solution to whatever problem I could not solve the previous day, so it is very common for me to start a day by jumping from the bed and going immediately to a computer, to turn it on and write down the new solution before I forget any details.
- qsdf38100 2y agoIt reminds me of some talk I had the chance to come across, I can’t remember which one. Sleep could be a training phase. Discerning whether inputs come from the real world or from the trained neural network itself would be the reward function. When it’s no longer possible to discerne reality from "fiction", the training is complete. And this could be somehow linked to the ability of training while simultaneously operating the network. I wish I remembered where I heard about it. Edit: I think this was it: https://www.youtube.com/watch?v=FBkhbqrFyo4 https://www.youtube.com/watch?v=FBkhbqrFyo4
- mikeiz404 2y agoI believe this paper shows that a part of the mouse brain responsible for telling muscles how to move when orienting also correlates with direction specific firings of neurons that are likely responsible for tracking the animal’s orientation and this occurs both while the mouse is awake and asleep. This updating of heading while asleep is considered a simulation. They take steps to experimentally show that this relationship exists and is likely causal. This paper doesn’t show that simulation is the purpose of REM (though it may be) however they do go on to speculate that the simulation that is occurring could be used to improve the brain’s predictive models of movement actions and their outcomes without needing to move the muscles. It is thus conceivable that the internal model that coordinates activity between SC and ADN observed during REM sleep may be at work also in the awake animal. This would allow the brain to predict shifts in head direction following the issuing of a motor command in the SC, before the motor command is executed and thus have a real time estimate of heading rather than depending on the necessarily delayed sensory feedback from the vestibular canals. … In the absence of error signals, these internal models are free to unfold and may represent the building blocks of the brain’s generative activity during REM or REM-like sleep in humans and animals.
- water9 2y agoThe purpose of sleep is to prepare a species for battle
- poikroequ 2y agoI've had so many dreams where it seemed like my brain was simulating some unusual social situation so that I would know how to behave and react in such a situation in real life. Especially situations that may cause stress or anxiety.
- tunnuz 2y agoI wonder if this is why we generally experience making better decisions when we have habits that foster good quality sleep.
- kjrfghslkdjfl 2y ago[dead]
- JumpCrisscross 2y agoHow prevalent is REM sleep? Does it map to sentience? (Fun aside: land mammals are the weirdos of the animal kingdom in that we turn our whole brain “off” at once when we sleep. Most animals rest part of their brain at a time.)
- ein0p 2y ago> This study suggests that the sleeping brain, while disengaged from the external world, uses its internal model of the world to simulate interactions with it. So we do live in a simulation, for a few hours each day.
- jpl56 2y agoLooks interesting. When will the article be peer reviewed ?