3 ms·
I've been thinking about it for a couple of minutes and here's the best description I can make in computer terms. For sight, it's a cross between off-screen re
by boricj 3y ago
I've been thinking about it for a couple of minutes and here's the best description I can make in computer terms.
For sight, it's a cross between off-screen rendering and overlay rendering. It doesn't feel like part of the world around me and it's not part of the streaming surface my eyes see so to speak. It's like a separate, independent layer that gets "halfway-composed", but with a stencil buffer that tells me it's not real. Bandwidth is restricted by focus, I can imagine and animate visually complex scenes but the more constraints I put in the harder it is to keep track of everything and not have a rendering glitch or artifact.
If I want to picture something specifically as part of my field of view (part of the world I'm seeing with my eyes), it's overlaid, but somewhat glitchy or ghostly and skipping frames, like it doesn't belong there.
For audio, I can replay, remix, compose, "infinite jukebox" and essentially deep-fake anything I've ever heard and it's overlaid on top of what I hear. Unlike for visuals there's no stencil buffer, so I can't tell the difference (except that it doesn't correlate with other senses, like loud noises rumbling your body for example). By default it's in mono, making it stereo or directional takes a significant effort. That processor tends to have a mind of its own sometimes and is vulnerable to earworms, like an infinite jukebox that just won't stop playing. Controls can be a bit iffy, like music seeking having trouble if it's not to a position that's correctly aligned or music "skipping" if I have trouble switching over to the next part of the song.
Finally, the act of imagining something is like ordering my subconscious with an AI prompt, but without text. Sometimes it decides to imagine stuff I didn't order or screws up what I've ordered, which can make me twitch a bit if it's something unexpected and that I don't approve of and need to actively suppress. If I'm particularly tired or stressed out, my brain can have trouble distinguishing between a real stimuli and a fake one, so I guess that's effectively hallucinations, but usually like echoes or corner-of-the-eye stuff rather than full-blown lala-land.