7 ms·
AIeyes: Walking simulator where the world is seen through a realtime neural net
- smallhands 5y agoMATRIX?
- radarsat1 5y agoSeveral layers, in fact.
- krm01 5y agoThis was fascinating to watch and felt like watching a video recording of a dream. Seeing the world through approximations instead of details.
- Swizec 5y agoYou’re gonna love learning about optical illusions – bugs in our visual processing. We already see the world through approximation. Obvious example: saccadic masking. Your brain shuts off visual processing during rapid eye movements[1]. You don’t notice the movement, the blur, nor the dropped frames. Brain fills it back in. Another cool one is how we deal with the blind spot in our eyes. Brain fills it in with a continuation of what’s around the blind spot. The area is big enough to hide a whole car or even a large truck at certain angles/distances. That’s why you have to turn your head when driving, just your eyes isn’t enough. You’ll get stuff flying at you out of your blind spot. [1] https://en.wikipedia.org/wiki/Saccadic_masking https://en.wikipedia.org/wiki/Saccadic_masking
- psychomugs 5y agoThe world models paper directly addresses seeing the world as an approximation [1], though in the other direction of compressing the world into a smaller but workable latent space by autoencoding. [1] https://worldmodels.github.io/ https://worldmodels.github.io/
- Agentlien 5y agoOn a tangent, I've experimented a lot with lucid dreaming and dream clarity as well as our recollection of it varies a lot depending on how deep asleep you are. When I'm calm and the dream is stable the visuals are incredibly sharp and detailed. I'm often amazed how lifelike it is. One issue seems to be that dreams get fuzzy as we start to wake up and our memory of dreams is often seen through a fuzzy lens even if things were clear during the dream itself. I've especially noticed this last part when being amazed at the detail and describing it to myself as I inspect it. Then I wake up and the memories are hazy and lacking the details I described.
- coldcode 5y agoI can't watch the video, it hurts to watch something so unstable. It would be cool if it was less psychedelic.
- luke2m 5y agoFascinating.
- Tepix 5y agoLove it! Very artsy. The music is also a good fit
- dragonitale 5y agoReminds me of MIT's DeepScope https://www.media.mit.edu/projects/deep-image-of-the-city/overview/ https://www.media.mit.edu/projects/deep-image-of-the-city/ov...
- nullc 5y agoneeds to be combined with the recent anti-aliased network work to get rid of the camera fixed texture effects. :) (e.g. https://nvlabs.github.io/alias-free-gan/ https://nvlabs.github.io/alias-free-gan/ https://richzhang.github.io/antialiased-cnns/ https://richzhang.github.io/antialiased-cnns/ )
- ampdepolymerase 5y agoAnd neural rendering to get realistic 3D scenes ;)
- renewiltord 5y agoWoah this is cool dude. Thanks for sharing.
- gunfighthacksaw 5y agoJust don’t add the grey guy from LSD Dream Emulator (1998)
- kgantchev 5y agoThe sound is super creepy... it's really out of a nightmare torture movie.
- exikyut 5y agoIt definitely made it a real strain. In the end I closed the tab out of sheer disinterest.
- spicybright 5y agoThis seems to be a unity game. Is there any way to play it on MacOS?
- ficklepickle 5y agoIn the comments the author mentions mac/Linux versions are coming.
- deertick1 5y agoMan this is awesome. The music is really sweet too. Its all fuckered up but still on beat and even has a pretty nice pocket to it. Those kicks that happen about every two measure slap
- neatze 5y agoThe video just freaked me out, because it is unbelievably similar to LSD trip experience (not a bad trip) I had in a very long past.
- Tenoke 5y agoWhat dosage are you taking to see that? I've never seen anything close to it.
- zanethomas 5y agotake more <g>
- deleted 5y ago[deleted]
- gavinray 5y agoAnything upwards of: - 300-400ug of LSD - 6-9g of mushrooms or 25mg 4-AcO-DMT - ~22mg of 2C-B/2C-E/2C-I - Nearly any amount of DMT or 5-MeO-DMT And a bunch of others will do this. Psychedelics are all unique feeling but the further you push the doses the more similar they become. At the furthest edge of the spectrum is the "grand psychedelic experience" which, in my incredibly unscientific & anecdotal opinion, is an (nearly) identical experience that you will reach every time, on any psychedelic, given the right circumstances and a high enough dosage. But this experience is just the "Can't see my hand in front of my face because of the visuals" level. You pass this level on the way to the last stop, if you take the ride all the way to end (whether you meant to take it there or not!)
- deleted 5y ago[deleted]
- whimsicalism 5y agolol this doesn't match my experience on acid at all. far too rigid/straight line-y
- gavinray 5y ago
- lemacintosh 5y agoIt’s the demented screaming at minute 2:00 for me.
- saklani 5y agoYou could have called it "AEye"... smh.
- IX-103 5y agoIt looks like they need to tweak their Neural network some. From the video it looks like the reconstruction network is confusing background and walls, which should not happen if they are distinct labels. I suspect they are passing the pseudocolor labelled images between the two networks instead of the one-hot labeled data that a vision system would normally deal with internally.
- Labo333 5y agoAny idea of how the music was created?
- junon 5y agoIt's just some pre-recorded thing, probably some producer made it or the game developer did it.
- ArekDymalski 5y agoSeems like may favourite artists were GANs :) both audio and video are strikingly similar to IDM/glitch stuff I love.
- j4yav 5y agoIt reminded me a lot of this Aphex Twin video: https://youtu.be/SqayDnQ2wmw https://youtu.be/SqayDnQ2wmw For now I prefer the human (curated?) one but you could imagine this improving to be really cool.
- hsnewman 5y agoLooks kind of like a multi-lens insect eye...
- coolspot 5y agoSee also GAN Theft Auto. HN discussion: https://news.ycombinator.com/item?id=27559106 https://news.ycombinator.com/item?id=27559106 You are a Tube: https://www.youtube.com/watch?v=udPY5rQVoW0 https://www.youtube.com/watch?v=udPY5rQVoW0 GitHub: https://github.com/sentdex/GANTheftAuto/ https://github.com/sentdex/GANTheftAuto/
- Jeff_Brown 5y agoThat's incredible.
- RustyConsul 5y agoMe watching this video makes me think i'll see full, conscious hard AI in my lifetime. You can never really point on the evolutionary timelines and say, 'That's it! that's when consciousness arose. It's obviously going to be the same with AI. When AI rises to the point where it is obviously conscious, there's never going to be one key technological breakthrough that put it over the edge. Like the fall of rome or anything complex really, it will be a collection of things and a backwards pointing measure of when it actually occurred. Jeff hawkins has some extremely interesting thoughts on AI. His book 'On intelligence' is one of the best books i've ever read. These aren't entirely his thoughts butThree things; some ability to move around your world (e.g. cyberspace, robots), perceive the world (Vision, data,dumps, training data, supervised learning, deep learning) Some mechanism with interacting with the world based on motives and desires. What happens if a non-sudo'd trading bot, with a wallet starts trading on the blockchain? Seed it with capital, have it access some smart contract, and delete sudo on both the smart contract and wallet. it's not doing anything too 'sophisticated' but it is a) able to 'Die' by it's wallets balance to hit zero. b.) has a 'motive' to increase it's total coins. pre-programmed, yes but also is ingesting data from oracles and acting on that information.
- andyxor 5y agothere is only one problem, most of these "AI" algorithms don't have an actual understanding of what's going on. These visual pattern matchers can't generalize beyond very narrow meaning of the word. You can train it to associate certain patterns with certain labels or responses, but it's basically a mechanical puppet that always needs a puppeteer to "train" it. As long as the prevalent view of AI is based on machine learning, using some form of optimization to match patterns, it has no hope of reaching AGI. It's fundamentally backwards looking and bigger models won't make any less "dumb", for a lack of better word. DL can probably represent lower levels of sensory processing, akin to dimensionality reduction in visual cortex, but it can't generate new abstract concepts from lower level ones, form clusters of such concepts and facilitate navigation in "concept space", in other words go from low level associations to "understanding". In natural cognition learning & memory are highly intertwined, and acquisition of basic knowledge is not based on some teaching signal or "delta rule" reinforcement, it's more akin to self-organizing hierarchical networks operating via very limited set of computational primitives such as JOIN and LINK, temporal synchronization and innate system of coordinates in abstract concept spaces via something like grid cells https://en.wikipedia.org/wiki/Grid_cell https://en.wikipedia.org/wiki/Grid_cell The constraints nature puts on living organisms, such as limited energy and time define the computational architecture of cognition. As long as these constraints are ignored AI will always be "5 years away".
- agbell 5y agoSo Jeff VanderMeer makes video games now? This is very creepy.
- tenith 5y agoNeural Networks see the world in such an odd way and it makes one wonder about what it means in regards to AI and how it will process the world. It puts pictures to questions and wondering many have had about how an artificial intelligence will view the world and makes why peole wonder about that perhaps more reachable to others as a lot of people need to see something.
- nyanpasu64 5y agoThe textures seem glued to screen space rather than moving with the blocks. Would the "alias-free GAN" network (https://news.ycombinator.com/item?id=27606347 https://news.ycombinator.com/item?id=27606347) allow implementing a similar network without these artifacts?
- jamiek88 5y agoWow I actually vibed with the music it was like some weird industrial, alien soundtrack with delayed but on beat drops.
- edem 5y agoReminds me of Terminal Slam by Squarepusher: https://www.youtube.com/watch?v=GlhV-OKHecI https://www.youtube.com/watch?v=GlhV-OKHecI ... and They Live: https://www.youtube.com/watch?v=JI8AMRbqY6w https://www.youtube.com/watch?v=JI8AMRbqY6w
- darepublic 5y agoOne step closer to AR glasses that anime-ify the world