9 ms·
DSReality: Turns a DS game into a 3D image that floats above your controller
- apetresc 3y agoNow that would be a compelling day one Vision Pro app.
- frameset 3y agoIt would be, except Apple don't allow emulators inside their walled gardens.
- hospitalJail 3y agoDon't use the marketing phrase 'walled gardens', its pro-corporate marketing jargon.
- jaywalk 3y agoWhen has Apple ever referred to their ecosystem as a walled garden? I've only seen it used negatively.
- Sardtok 3y agoTo me "walled garden" sounds pretty negative. It's a wonderful place unavailable to pretty much everyone. Some pretty anti-democratic, capitalistic s*t. But I suppose it carries different connotations for different people. What's your preferred terminology? "Monopolist prison" comes to mind as an alternative that's not possible to interpret positively.
- cubefox 3y agoGolden cage?
- pxc 3y agoDon't call it an 'ecosystem': it's a zoo.
- ChrisRR 3y agoHow do you figure? I've always seen walled garden used in a negative sense
- mholm 3y agoI can load up an emulator on my mac just fine. Whether the Vision Pro allows installs outside of the App Store is still unknown.
- lcfcjs 3y ago[dead]
- nirav72 3y agoThis might work better on the XReal AR glasses that allows for multiple types of input sources.
- robobro 3y agoThis Readme doesn't really explain anything. I don't understand what this is meant to do.
- apetresc 3y agoIt's pretty clear from the title; it's an AR app that projects an emulator over top of your controller. Sounds pointless if you're using a phone as your window into AR, but if you were to imagine this on a headset like a Quest or Vision Pro, it would basically "turn" any controller into a handheld retro console.
- ImHereToVote 3y agoThen why isn't it running on Android? That would instantly work on the Quest. Why would someone voluntarily subject themselves to xcode? People need to treat themselves better.
- KeplerBoy 3y agoARkit presumably. Android just doesn't have an AR ecosystem that's as mature.
- jwells89 3y agoWhich is interesting, because the release of ARKit doesn’t pre-date that of Android’s ARCore by even a whole year, and as I recall Google was dabbling in AR before Apple was. The difference is that ARKit has received consistent attention and iteration.
- sshff 3y agoWell, there was a clear and specific product driving it in the Apple camp. Not just to get it ready for the dev kit for VisionOS devices but to get their dev teams a constant flow of useful data from any AR apps created in ARKit along the way that have likely fed into the design decisions and roadmap of the entire project. I’m pretty sure ARKit has been 99.99% in existence as a way of getting as much real world data as possible for the headset design and ‘spacial computing platform’ project.
- senkora 3y agoIt would be cool to see something like this that could handle the 3D slider on the 3DS.
- PaulHoule 3y agoI've been thinking about making a stereogram viewer for my Hololens 1, I think you can make a left and right texture in Unity.
- xwdv 3y ago[flagged]
- dagmx 3y agoYou’re basically describing the looking glass and it’s been available for several years now with a Unity 3D framework if you did want to build games for it https://lookingglassfactory.com// https://lookingglassfactory.com// And as others have said, please don’t be so dismissive of other people’s work. “Meh” is a dismissal, not even critique.
- xwdv 3y agoNo, I mean more along the lines of the Voxon, not looking glass.
- spookie 3y agoIt was a single person doing it, pretty cool
- yboris 3y ago"Meh"? Please consider what it would feel like to be the sole developer working on this project and then to hear this response from someone in person who you excitedly share the idea with. This is not a nice way to respond to someone in person, and it isn't a nice way to respond online. Consider a rephrase: "This is awesome. I am really looking forward to the world when holographic displays make this possible without AR".
- pdntspa 3y agoLet people express their true feelings. We shouldn't be blowing smoke up each other's asses. Criticism is a fact of life and we can't culture our way out of it. There is "nice" and there is honest. And neither are kind (though honesty is much more likely to be kind)
- dagmx 3y ago“Meh” isn’t critique let alone criticism. It’s dismissal. It’s not even relevant to this project because what are they expecting them to do? Make bespoke hardware for it? It’s a link to a GitHub page It’s like if someone posted a new Tesla and someone replied with “Meh, should have been a Jetpack”. It’s just completely irrelevant if one were to take as criticism/critique. It’s pure dismissal
- nickspacek 3y agoWhat I find very cool is that it's extracting scenes from the running game and then projecting them into the VR space, allowing the scenes to be panned/rotated in a way that isn't possible in the original game. If you haven't watched the video, check it out; my assumption from just reading explanations here was that it was just projecting a facade of the emulated device and its normal rendering of the game into VR.
- qingcharles 3y agoThe video is wild. Now we need an AI 3D infill to block in all the missing data at the edges of the view.
- kridsdale3 3y agoI actually originally assumed this was entirely done by some AI interpretation of the original 2D projection of the game scene, conjuring the entire new 3D scene. But of course, just extracting the vertex data from the emulator is way better.
- LegitShady 3y agoI remember all the way back when this round of VR was new I was using a driver called VorpX to reinterpret non vr games into VR. https://www.vorpx.com/ https://www.vorpx.com/
- HanClinto 3y agoThis is extremely impressive! I was very confused until I saw the video, and then it all made sense. Excellent work!
- duxup 3y agoI feel like we are living in the start of a golden age of homemade hacks.
- secretsatan 3y agoWith ARKit you could probably get it to recognise and track the controller using it's object recognition, there's sample code here : https://developer.apple.com/documentation/arkit/arkit_in_ios/content_anchors/scanning_and_detecting_3d_objects https://developer.apple.com/documentation/arkit/arkit_in_ios... Then you wouldn't have to strap the phone to the controller I'm not so sure about RealityKit, I found it doesn't have the flexibility and finer grained options of ARKit, it's annoying that Apple make 2 frameworks for AR but don't have the same features in both
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- nfriedly 3y agoA few comments suggest watching the video, but since it's not quite obvious, the video is embedded in this tweet: https://twitter.com/zhuowei/status/1671532250020683787 https://twitter.com/zhuowei/status/1671532250020683787 / https://nitter.net/zhuowei/status/1671532250020683787 https://nitter.net/zhuowei/status/1671532250020683787
- btbuildem 3y agoThanks! This made absolutely no sense until the video
- tombh 3y agoI still don't understand it after watching the video. Is the video recorded through a VR headset?
- Arnavion 3y agoIt's a recording of the phone screen running their app. The input of the app is the phone's camera, which they have pointed at their hands holding their Switch. The output of the app is the input plus the game overlaid on top of the Switch.
- post-it 3y agoBut is the idea that this would eventually run on a VR headset?
- MostlyStable 3y agoOh hey! Nitter is working again! Good to know
- jonhohle 3y agoI was hoping for some polarization and high frame rate trick to allow a passive, reflective screen to show the top screen.
- mrguyorama 3y agoThis seems like an incredibly specific demo. Even they say that it doesn't work with games that aren't mario kart. Unlike the NES which has only a few ways to layout the display, which the 3D NES emulator relies on to get good results, the DS can do arbitrary 3D stuff. It also has no API layer to reliably extract the camera information to generalize this kind of re-projection. Neat looking trick but its sort of a dead end. It requires hand written code for any game you would want to do. I'm also curious about the rendering artifacts visible in the demo. The DS is very much the wrong choice for this. They should try something similar with Dolphin and gamecube games, because the community there already does some stuff with camera manipulation.
- edflsafoiewq 3y ago> It also has no API layer to reliably extract the camera information to generalize this kind of re-projection. What do you mean?
- kridsdale3 3y agoThere is a fork of Dolphin for VR. I played a few minutes of Zelda with my Oculus on several years ago. Pretty trippy to be transported to a game I enjoyed on a CRT 22 years ago, with a life-scale Link staring me in the face, 3 feet away.
- cubefox 3y agoThis reminds me that there seem to be few "VR ports" or "cross platform VR releases" of normal games. I guess the gameplay of standard games doesn't necessarily work very well with the inherent limitations of VR. (E.g. nausea from moving around too much)
- crtified 3y agoThe nausea thing is quite a dealbreaker. If someone had told me ~15years ago that one day I'd have the ability to play a VR version of Super Mario Galaxy, but that, when that time came, I wouldn't even bother to try and play it, I'd have (1) had a hard time believing it, and (2) assumed that future gaming must be godlike, in order to make me not bother with SMG VR. But the reality of it, is so much more human and boring. That is, I know from playing far-more-tame 3d motion games in VR, that it actively sucks as much as it rules. The eyes are saying Wow, and the rest of the body is saying No thanks, in a way not experienced before++. As such, when I heard of Dolphin VR last year, I didn't even dream of using it. Even the mere thought of trying to do SMG levels in VR is intimidating. ++I grew up loving roller coasters, and was the only local kid that never got sick on rough boats, but this, this is something else.
- juujian 3y agoI mean, that is pretty cool but... It seems kind of obvious that they could have just printed the QR code and taped the paper to the switch instead of using rubber bands to attach a phone to their switch...
- riscy 3y agohaving a spare phone is probably more common than a printer these days
- post_break 3y agoDoesn't the phone control the accelerometer data?
- kridsdale3 3y agoWho needs an accelerometer when you're just interpreting polygon transform/coordinates in a camera view (the camera that recorded the video)
- juujian 3y agoOh, I thought those came from the switch. Then why not do away with the switch though. Ok, probably just very improvised, quick demo indeed.
- prophesi 3y agoNot sure why this is getting downvoted, I thought the same. Having worked on plenty of projects that rely on tracking a QR code, you'll get a much more stable experience scanning it on paper than an LCD screen.
- LegitShady 3y agonot for DS/AR but for directx VR vorpx did it first. https://www.vorpx.com/ https://www.vorpx.com/
- cubefox 3y agoThis makes me think, is there a Nintendo 3DS emulator for VR by any chance? Unfortunately non-VR screens which are able to display stereoscopic 3D are getting increasingly rare again.
- esjeon 3y agoI think this type of camera control has some big potential in the AR market. It's not fully submersive, but (1) (almost) no nausea because you're peaking into the world (2) screen everywhere (3) can be used in many genres ranging from casual to RPGs and actions (4) feel more natural to existing gamers. Somehow this made me more convinced with the future of AR, but not VR.
- ge96 3y agoSadlyItsBrad demoed something similar
- Woshiwuja 3y agoThis guy needs to cut his nails tho