17 ms·
New report on Apple’s VR headset: 8K in each eye, potential $3k price tag
- polote 6y agoWell if true that would be a good news. Can't wait that more R&D is pushed into VR so that it becomes more than a toy. And especially Apple who knows how to release hardware that works
- steve_adams_86 6y agotypes in broken MacBook keyboard Jokes aside, I agree - I think they're taking their time with this and it might bring something interesting to the scene.
- uncledave 6y agoJony is gone. We can expect stuff to actually work now rather than just get thinner and shitter.
- mhh__ 6y ago> And especially Apple who knows how to release hardware that works All the "serious" HMDs on the market today work just fine - Valve have put some serious engineering into their tracking technology, for example.
- LeoPanthera 6y agoI was hoping that Apple would be making AR spectacles, and not a VR headset. I was really excited by the possibilities of Google's Glass and really disappointed when they killed it off. I want a HUD in my glasses. I want to read text messages and get navigation directions without having to look down at a screen.
- baybal2 6y agoI myself heard those would be explicitly VR glasses, though transparent, but without any "mixed reality" type fluff.
- gfodor 6y agowith 8k in each eye and passthrough cameras these will probably feel like glasses.
- verdverm 6y agoYou're looking for a Hololens 2 like device, maybe HL3 will get there. HL2 is quite good imho, I've browsed HN while drinking coffee on the balcony. It occludes based on the environment (i.e. you can't see objects through walls) To get this you need outward facing cameras, which people will balk at for privacy.
- Impossible 6y agoGoogle glass and some other products do this already. Although products like glass and Hololens (and Apples new headset, apparently) are all targeted at enterprise, not consumer, there's nothing stopping individuals from buying them
- ihunter2839 6y agoI used Google Glass in person for about 10 minutes, and after so much oh-ing and awing over the tech, for me it was pretty disappointing to experience. It felt like I was using a cheap Android system from 2012 overlayed onto reality and, uh, it wasn't that great. That being said, I only got to see a few basic apps in action, and maybe I didn't get the full tour of the hardware's abilities. Personally, I think that VR will win out, even for AR applications (or maybe my semantics are incorrect). I can imagine a VR system that uses external cameras to mimic a person's natural field of view and overlays additional information in the process of displaying it. It seems like a more available route to a fully immersive "augmented reality" than the current glasses based prototypes.
- juancampa 6y agoJudging any bleeding edge tech by its first prototype is not particularly useful. The point is not what Google Glass was, but what could've become with steady improvements. VR cannot replace AR anytime soon due to some obvious safety issues. At the moment they are and will remain separate things IMO
- ipsum2 6y ago> It felt like I was using a cheap Android system from 2012 overlayed onto reality and, uh, it wasn't that great. Considering that Google Glass was created in 2013 with hardware smaller than a phone, thats actually exactly what they made! After Google Glass got canned, all of the talented engineers went to different projects. I assume their enterprise version is basically the same 2013 glass.
- russdill 6y agoYes, it'd be great if they could somehow solve all the engineering problems with AR headsets and bring something usable to market. It'd also be great if they could make batteries that are 10 times as energy dense and processors that don't produce waste heat. They can make an amazing VR headset right now, a comparable AR headset is many many years if not decades away.
- jayd16 6y agoHonestly, I think the bulk of the benefit of Google Glass can be had with a smartwatch. Its not like Glass was able to do any AR or scene detection.
- everly 6y agoThat’s not true at all, off the top of my head there was: -WordLens, which could translate and overlay text in different languages -Star Chart, which overlayed the name of the star/planet/constellation you were looking at -Don’t remember the name of the app, but it would tell you the color hex code of whatever you focused the lens on Several others that I can’t think of. I agree that a smart watch overlaps in terms of notifications but the glass absolutely did AR and scene detection that put it on another level.
- jayd16 6y agoThe display did not augment reality, it was simply a small display in your view. It also did not spatially scan but it did know your rough location and where north was. It did things a smartphone could do but much worse. It's main advantage over a phone was that it was always on and didn't need a hand to hold it, which are key benefits of a smart watch.
- everly 6y agoOk but if you are looking through that small display and you are seeing digital labels placed on real items that you are looking at, how is that not augmented reality? Like I said, there’s definitely overlap but you’re way underselling some key features. Smartwatch also can’t take a photo of whatever you’re looking at simply by winking.
- jayd16 6y ago>how is that not augmented reality Again, if that's how you want to define augmented reality then we already did it much better on phones. A smart watch achieves the goal of a passive HUD better than Glass did. Whats left is a head mounted camera and I don't find that very compelling. The tradeoff between wearing glasses and having a much worse camera vs not having to use your hands to shoot a photo was not good enough in that device. I mean, you're free to like it. You have to admit that its not just me who thought Glass did not have enough compelling features. Hasn't the market spoken for Glass?
- e28eta 6y agoidk if this prediction is already all over the place, but sure sounds like the iPad pricing: Rumors say $1k, launched at $499 for base model, lots of press about how affordable it is.
- baybal2 6y agoI heard that they hit a snag few years ago when they ran into spat with Beijing University which controls the critical display tech. I also heard that iGoggles projects was closed, and launched again 3 times already.
- RandallBrown 6y agoI bought an Oculus Quest 2 when it came out and it's pretty fantastic. The whole experience with setup and gaming is excellent, especially for the price. There are plenty of little rough edges that I feel like Apple would do a good job of smoothing off. Things like not being able to get phone notifications or use bluetooth headphones.
- Rapzid 6y agoWere you as blown away just by the setup and first tutorial "game" as I was? I bought it on a whim over the holidays when I was upgrading my PC. Haven't used a VR headset since the Oculus devkit 2. Had no idea how far along everything had come; particularly tracking. By the end of the first day I had my tape measure out moving my couch, coffee table, and clearing out the living room. It's the VR space now.
- RandallBrown 6y agoProbably. The "game" where I danced with the robot blew me away. It really felt like I was dancing with someone else.
- hppb 6y agoI could see this as a virtual office, as some of the comments speculate. If I had a set of AR glasses that projected what appeared to be an 8K monitor on top of my dining room table, and integrated with my MacBook Pro for input / output, and that had batteries to last a workday, I’d pay $2K/$3K. Even more if it worked well at brightness levels I’d have in my backyard. Never mind gaming, mobile high-quality virtual office is good enough.
- mycall 6y agoFurthermore, I would be willing to use 16-bit colors for higher resolution.
- messe 6y agoI wonder if a little bit of dithering would be enough to compensate for that at that high a resolution. The actual area of our eyes that can resolve colour is quite small, so it might work.
- bigiain 6y ago16 bit colours on a pair of 8K screens is the best part of half a gigabyte per frame... I assume sir will be wanting 60 or 120 FPS as well? :-)
- chomp 6y ago802.11ay can hit that at 15fps theoretically, and if apple culls peripheral video, it may need way less bandwidth!
- TedDoesntTalk 6y ago> potential $3k price tag Doesn’t matter. People will line up out of the door for them because... Apple.
- uncledave 6y agoHey some of us Apple fanboys are cheap asses :)
- abiogenesis 6y agoThat sounds like an oxymoron.
- gambiting 6y agoWhy? You can be an apple fan and just not in the right bracket to afford the latest devices. I know plenty of people who love apple but they are still on iPhone 7 and 2015 macbook since they cannot afford anything newer. That's absolutely fine. It's like I love Omega watches but I can't afford a brand new one - so I have a vintage one instead since that was what I could afford.
- abiogenesis 6y agoMy point still stands. I wouldn't call someone who buys a vintage Omega instead of a Casio "cheap ass".
- gambiting 6y agoWell you wouldn't, but then maybe you haven't met some watch snobs. To some people if you can't afford a brand new Rolex/omega and have to "settle" for a vintage one you're a cheap ass. My point is that any group for literally any product ever will have people trying to one up each other.
- encom 6y agoIt is literally an Apple Reality Distortion Field.
- endisneigh 6y agoWhat's the necessary resolution in each eye needed to be "retina"? Once we reach that will it be the end of the "monitor era"? A lot of interesting things can happen once you no longer need monitors. Though sharing with others will still be a practical limitation so I doubt they'll go anywhere for now. Once you no longer have monitors I think there will have to be a UI and UX shift around how you interact with things. Windows made sense because you had a fixed set of boundaries. If the boundaries no longer exist it probably doesn't make sense to have windows in the traditional sense anymore. You could have an infinite set of context sensitive menus that appear as necessary.
- hetman 6y agoI feel like the windows are there to create context for the human brain, not because they resemble the shape of the screen. These context may look a little different to windows, but I don't think they will be radically different in principle and will still maintain a distinct resemblance to the physical world. That's what our brains are moulded to best interface with after all.
- Strom 6y agoDepends on the field of view angle you want to achive, but 8K is unlikely to be enough. Back in 2015 Michael Abrash said: In order for it to have retinal resolution across a field of view of 180 degrees it would have to have something on the order of 16K by 16K resolution [per eye]. [1] -- [1] https://youtu.be/UDu-cnXI8E8?t=4232 https://youtu.be/UDu-cnXI8E8?t=4232
- bostonsre 6y ago> Apple will liberally use an already-known VR technique that involves using eye-tracking to render objects in the user's periphery at a lower fidelity than what the user is focusing on. Should be enough if they don't have to render that full view, but only what the retina is focusing on I would think.
- jacquesm 6y ago
- hehehaha 6y agoIsn’t this a clear indication that Apple will have its own stand-alone GPU line? This plus the car news from earlier this week made me think Apple already has its own GPUs to rival or surpass Nvidia. Edited for clarification.
- jayd16 6y agoApple already puts GPUs in its chips. If you're suggesting a line of PCIe cards, I don't think that's indicated at all.
- auggierose 6y agoApple already has its own GPU line. It is in all iPads, iPhones, and M1 Macs.
- perardi 6y agoAbove all else, Apple must do one very, very important thing to make this product succeed: Do not let Robert Scoble take a photo of himself in the shower wearing this.
- Tomdarkness 6y ago8k seems... optimistic. The PPI of such a display would be off the charts. Not to mention the kind of hardware required to run such a device. The NVIDIA RTX 3090 can barely run a 3D 8k game at 30fps, let alone in 3D for VR. What would you even connect such a device with? Displayport and HDMI wouldn't support two 8k streams.
- riggsdk 6y agoSince they do mention eye-tracking they can heavily exploit foveated rendering which will make the resolution extremely high at the exact point where your eyes are looking and much lower in the outer regions of your vision. This is practically unnoticeable (if done right) and allows for much more interesting performance optimizations. Full 2x8K in 90Hz is impossible otherwise.
- jayd16 6y agoPart of the problem with foveation is its pretty noticeable and mildly annoying for not a huge gain.
- samtimalsina 6y agoUnnoticeable if done right.
- jayd16 6y agoI think part of the problem is the peripheral area where you wouldn't notice but still see is so thin that you don't save a lot. Maybe Apple has cracked it, though.
- bigiain 6y agoMight also be that peripheral vision is more sensitive to movement, and the edges where the lower res and higher res rendering meets could make for distracting discontinuities that look to the reptile brain (or the preprocessing in the retina/optic nerve/visual cortex) like a tiger...
- useful 6y agoI bet this uses DLSS to get the resolution. I see no one talking about it but why push a high bitrate when you can just upscale with AI.
- MikusR 6y agoDLSS is a NVIDIA technology. Apple and NVIDIA don't quite like each other.
- t-writescode 6y agoThey could be using "DLSS" to refer to any sort of highly capable resolution improving software, not nVidia's specifically.
- MikusR 6y agoSo Apple (known maker of Galaxy phones) is going to be using DLSS for their Oculus Quest?
- t-writescode 6y agoOoooh, I see. You’re choosing to give people a hard time and nitpick, rather than respond to their intent. Good choice :)
- renewiltord 6y agoThis is like those guys who are like "No, you can't SLI two of those cards" "Oh, I guess I should just get Nvidia then" "Of course you could Crossfire them" wat Nice one. Hope you're proud.
- djrogers 6y agoAll of the Apple rumors from 'reliable' sources recently have pointed to the first round of hardware being specifically a) intentionally expensive and b) a developer kit, not a consumer product. While $3k and a pair of 8k displays seems a bit extreme, it would fit the current narrative.
- IntemerateApe 6y ago$3k sounds like a reasonable price point to me.
- trixie_ 6y agoApple CPU/hardware + Apple display technology + Apple software would easily justify the 3k price. And people would pay it. Not just because it's Apple, but because Apple has the means to vertically integrate the entire tech stack into a high end product that far surpasses what their competitors are capable of. Google Android software and Qualcomm hardware have been trying for a decade and still can't match Apple. So yea, Apple is poised to dominate VR. The next big ticket, high margin device that every human being on the planet will want. Forget the Apple car. If they can achieve 8K VR, they are steps away from having a device that can put you in the same 'meeting room' with someone else (like your friends, family, co-workers, etc..) and have it be visually indistinguishable from the real thing.
- wyxuan 6y agoRumors indicate this to only being a transitionary product for AR. Sorta like a dev kit, but not named that way.
- trixie_ 6y agoThe future of AR is VR. With 8K screens you just redraw reality.
- ghaff 6y agoAR seems far more interesting long-term. Real-time information about what you're looking at. VR seems much more entertainment, architecture,etc. focused--games, exploration, etc. Which isn't small but not necessarily transformational.
- trixie_ 6y agoLike I said the future of AR is VR. People are already recreating their rooms and spaces in VR. Just extend that to wearing the device all the time. People dont want to see reality. They want to see their own version of it. Cloudy days become sunny days, etc.. etc..
- 6y ago
- cccc4all 6y agoHow are they going to handle bandwidth for 8k in each eye? wired, Wifi, bluetooth, freaking lasers?
- smilespray 6y agoOn the device.
- DesiLurker 6y agofreaking lasers attached to the head because every consumer deserves a warm-UX?!
- offtop5 6y agoThank God, with oculus being hostile towards consumers this provides a much-needed option,. I strongly suspect this will be the first year pro model, and next year so we'll see a consumer model. Assuming it runs on an a12 or an a14 chip existing iOS apps, I.e Unity projects will run out of the box. So I could imagine developers being able to get games out within a month or so. I do wonder if Unity has some type of top secret team which has early access to the Apple apis ( at least a phone number to call Apple's internal tech team/
- iandanforth 6y agoDon't expect this to be a consumer focused VR headset. MR is for work, and this will be closer to a hololens usecase than a general purpose gaming system.
- djrogers 6y agoAn A12, or even an A14 chip can’t push dual 8k video streams today. Maybe an A14x or M1x with way more GPU cores could pull it off, but even then I think we’re talking about another huge leap over what we’ve seen out of Apple Silicon thus far. That said, this excites me - I wouldn’t be buying a gen 1 at 3k, but down the road I could see replacing a laptop or two with this kind of thing.
- throwaway316943 6y agoAgreed, I’ll pay $3000 just to keep Facebook from invading my (VR) life.
- intrasight 6y agoFolks here are discussing the difference between AR and VR. My own take is that it's a difference of implementation. Quality VR with quality external cameras is going to give you a MUCH better experience than would AR glasses, and can of course do many things that VR glasses could not. I do think that AR glasses are much more practical and will have broader applicability. But perhaps not so much after a great VR implementation by Apple.
- t-writescode 6y agoVR is fail-deadly, AR is fail-safe by design and there's no way of getting around that. When VR fails, it's a black screen covering your head, whereas AR is the world around you. There are many circumstances where AR is far better than VR, even with perfect VR
- pfranz 6y agoAR is also much, much harder. Refresh rate doesn't just have to fool your brain, it needs to "stick" to reality. Plus, you're adding environment tracking and integration. If you're using a glasses model, the only techniques I've heard of darken the environment and the CG element lightens things--this makes integration difficult. I imagine you could use some tricks if you did AR with cameras pointing out and displayed them on a screen (this seems to be what the parent is implying), but you go back to "failure" being a black screen. In practice, I haven't seen this be a big deal. The display is black when it is off (like your phone assuming it doesn't put the screen to sleep). If any rendering misses a frame they distort the previous frame in the buffer to match any head movements (in AR likely reintegrate with new footage).
- intrasight 6y agoSo you take them off when they fail. And file a bug report.
- t-writescode 6y agoI’m imagining a world where they’re so ubiquitous that they’re used when walking or driving, etc, because they provide a HUD. This is far down the line.
- spoonjim 6y agoApple FaceTime is already the best person to person video experience... this could be the best person to scene experience. Ie. Tour ancient Egypt with Apple VR.
- mensetmanusman 6y agoSaw a really interesting talk about the human eye in regards to resolution limits. A single frame for an eye is something on the order of 1-10 megapixels, but the signal processing of the brain with the vibrating eye effect create something approaching a gigapixel image using what may be analogous to temporal resolution enhancement: https://www.osapublishing.org/boe/fulltext.cfm?uri=boe-8-3-1981&id=360479 https://www.osapublishing.org/boe/fulltext.cfm?uri=boe-8-3-1...
- bottled_poe 6y agoYes... human vision is best thought of as a stream of visual information (i.e. temporally related data). A single frame isn’t really a meaningful measure of human visual capacity.
- germinalphrase 6y agoWhile the cultural and cognitive effects feel potentially threatening, that augmented reality could become real in my lifetime is exciting.
- zepto 6y agoBear in mind that the iPad was rumored to cost >$1000 but then launched at $499. On the other hand it might sense to launch this as a pro-workstation for the usual kinds of task: architects, designers and engineers being able to visualize and interact with models directly in space. If they can make that affordable and usable for pro designers at every level, (which $3500 clearly would be), they will have a hit. A consumer gaming device can come later.
- yaomtc 6y ago> A consumer gaming device can come later. They had a partnership with Valve back in 2017 for Vive support on MacOS... Just three years later it was canceled. (There were actually more VR games running on Linux at that point than on MacOS, thanks to Proton.) I'm not expecting Apple to try to enter the VR gaming space again anytime soon.
- TheDong 6y agoThere are more games on the iOS app store than exist on steam. I don't think apple needs valve or steam's support to make their own VR gaming platform just as they didn't need their support to make iOS a larger app-store for games than steam is.
- lupinglade 6y agoI don’t think one can really compare the games on iOS to those on Steam.
- sircastor 6y agoNo, but you also couldn’t compare games on prior mobile devices to those which iOS enabled. I think the more appropriate thing to consider is that Apple has a lot of Developers familiar with its platform
- dagw 6y agoThe Oculus Quest has shown that a lot of people are very happy playing 'iOS' quality games on VR.
- funkaster 6y agoIf anything, what I’m mostly looking forward here is mac support for VR. If I was able to use current Quest 2 with link to a mac, that would make me very happy.
- abrookewood 6y agoDo we know what the effects are likely to be of wearing a VR headset for hours at a time? I don't think our eyes are going to be happy with a fixed focal length for an extended period of time. At least when I'm working on a laptop/desktop, I'm constantly looking around the room, at my keyboard etc.
- dcre 6y agoThere is not a fixed focal distance in VR. The screens are an inch in front of your eye, but the objects you look at can be (virtually) at any distance. It’s like normal vision. The question of the effect on vision of shining screens into your eyes for hours at a time still stands. Edit: whoops, guess I was wrong about that!
- refulgentis 6y agoOver the years ive found it increasingly difficult to find a way it could be harmful: latest nugget that comes to mind is that daylight is 1000s of times more intense than any indoor light
- colordrops 6y agoI don't believe this to be true - don't you need a light field for this to be possible? i.e. what magic leap was doing?
- mpoteat 6y agoIt is obviously saliently true just via direct experience. Your eyes focus at different distances when looking at 3d objects in VR. You can feel it! I am not a physicist by any means, and I am not sure what a "light field" exactly is in terms of engineering, but as a everyday skeptic I am generally rather wary of anything Magic Leap puts out.
- repsilat 6y agoNah, they have fixed focus (I think at infinity, but that might not be true). You use other depth cues in normal VR systems, but not focal depth.
- Nokinside 6y agoThat would be step up from the current state of the art https://varjo.com/products/xr-3/ https://varjo.com/products/xr-3/ Focus area 70 ppd uOLED, 1920 x 1920 px per eye Peripheral area 30 PPD LCD, 2880 x 2720 px per eye field of view (115°). price €5495 + then some
- leoh 6y agoThe problem with Apple is that although they care about privacy, they don't deeply care about the addictiveness of their products. 30-50 years from now: * in society, concerns about privacy will become fringe * concern about addiction to computational worlds and deeply impaired cognition due to this addiction — initially via iPhones and ultimately by VR — will be the the true concern of the era, not unlike cigarettes
- threeseed 6y ago> they don't deeply care about the addictiveness of their products Apple products aren't inherently addictive. It's the applications that are. Also they do provide Screen Time and other features to control your usage of their devices.
- DesiLurker 6y agoI somehow read it as per eye pricing and instantly went to "wow apple is getting really stingy these days".
- staticvar 6y agoAs a casual gamer who pays $2k for a TV, $3k sounds ok for something better than a tv. Sign me up.
- deleted 6y ago[deleted]
- oliv__ 6y agoSooo looking forward to being able to live fully in a virtual world. Virtual cash, virtual socially distanced "relationships" and friends, a virtual body so I don't have to work out, and Neuralink attached to my brain (or whatever's left of that) so other people can make decisions for me. What a relief it's all coming together
- judge2020 6y agoThis is super sci-fi but i'm wondering if we'll get anywhere near incubating a brain (or simulating existing brains) so that it doesn't have an aging body to deteriorate and render it useless (of course, this wouldn't solve other brain-damaging disease). A virtual environment would be used to simulate the inputs and record the outputs so that you effectively live longer//forever (perhaps you could choose to terminate at any time). This is basically the plot of San Junipero but with the vast resources going into ML, neuroscience, and anti-aging, it's not hard to imagine this being a possibility within the next 100 years.
- playcache 6y agoIt's an interesting premise to look at where this tech will take us. Decades ago social media was seen as a technology to bring people together with no borders to share information in a possible new utopia. Even though elements of that have occured, we have seen that its also caused a myraid of mental health / well being issues by rigging into peoples reward systems where likes become dopamine hits with hours of each day spent endlessly scrowling through feeds. In a way this tech concerns me in that its another enitcing route to retreat from the natural world.
- throwaway3699 6y agoSame as television did?
- JonathanFly 6y ago>Sooo looking forward to being able to live fully in a virtual world. Virtual cash, virtual socially distanced "relationships" and friends, a virtual body so I don't have to work out A surprising aspect of VR is that this is actually the complete opposite, just how much your real body actually matters. VR is exhausting. 10 minutes of Thrill of the Fight and I'm physically incapable of continuing. An hour of Rec Room or Echo VR and I have to stop from the sweat buildup. Even hanging out and just talking VR Chat is so more physical (standing, actively interacting with both arms, potentially full body tracking) than sitting at a desk during the day job, more comparable to something like being at a conference where at the the end of day you really feel it, all the standing around and slow walking, since in total it was more than an average day.
- pronlover723 6y agoThe #1 use of VR headsets is porn and porn apps are growing. Porn apps have some advantages over video apps because * a VR porn app is 6DOF, VR video is 3DOF * a VR porn character has more presence. Their eyes can follow you, they can turn to face you, they can reach to your face, hands. * You can interact at a VR character. You can't with a video In other words, either Apple is going to need to support porn apps on the the app store or they're going to need to allow 3rd party stores.
- n42 6y agowhich apps would you say are pushing the industry forward? there's a lot of junk out there. asking for a friend.
- garbagetime 6y ago>The #1 use of VR headsets is porn and porn apps are growing What exactly do you mean by this? Are you saying that right now, the most popular use of VR headsets is for pornography? Or are you speculating on how VR headsets will be used in the future?
- pronlover723 6y ago> Are you saying that right now, the most popular use of VR headsets is for pornography? Yes, that's what I'm saying. It's a "dirty little secret". Most of it is VR video at the moment but apps are growing quickly. New titles appearing on steam all the time and appearing on the top 10 selling titles.
- wruza 6y agoI have all adult content on on my steam account (just checked my filters), and top selling VR section shows me Alyx, Beat Saber, Borderlands and other popular games as usual. Is there an additional setting to see that?
- augstein 6y agoAbout which apps are you talking specifically? I‘m a long time VR user and except for some concepts I haven’t seen anything like what you describe, certainly not that popular.
- giffarage 6y agoI wouldn’t even pay half that.
- aaron695 6y agoI like they way people fixate on the hardware, not the billions of dollars it will cost for the software. Needing 8K models and exponential extra difficulties will fix Cyberpunk 2077 and design software?
- tijuco2 6y agoAnd they will pay
- chippy 6y agoThey will, but the deeper question is why. People are invested in the Apple ecoystem. They have an iWatch and it only really works with their iPhone. They have iTunes with their mac pro. Apple is incredibly good at brand and interaction. So how would a VR headset work with everything? 1) the iphone has the best facial tracking camera and software (better even than desktop and webcam and GPU) 2) like the Occulus, you should only need a phone to connect. 3) only 1 vr headset currently has an internal camera able to track faces and eyes. Facial expression, iris movement and gaze tracking is hugely missing currently, but trivial with the iphone. I would have the iphone being the base station and do the full body tracking "just put it on your desk". I would also put their existing face tracking and eye tracking tech inside the vr headset. I'd make it so the headset only needs an iphone to connect. I'd make it cordless only.
- devwastaken 6y agoThis is the opposite direction for VR. We are at a prime time to be using algorithms that can read face gestures, track eye location, we need much better full body tracking. Users are happy with 2K per eye, but they're not happy on how nobody but Oculus Quest is making an affordable and well featured headset. It's even perfectly useable entirely wirelessly with Virtual Desktop. Apple has the arm tech to be making high performance mobile headsets that can use their high quality cameras for tracking. Oculus almost has no controller hand tracking down, they're limited by the resolution and number of camera trackers though.
- cyanf 6y agoAbsolutely, the walled garden of Apple combined with the high price tag will lead no where.
- MaxikCZ 6y agoWait, you asked all users? Because 2k per eye seems enough until you realize that it gives you less than 20 ppd (pixels per degree), while 2560x1440 27'' monitor at 50cm gives you 40 ppd To get same ppd on 27'' monitor at 50cm it would be 1111x625, for 24'' at 75cm its 700x400!! My point is that while current ppd might be fine for some, its very low for anything that requires detail. Any small text or gauges or similar is simply not readable in VR while being crystal clear on FHD monitor, just because the field of view is stretched so wide in VR headsets. You can say that small text isnt important in VR, but that would be dismissing the fact that small text and higher feature resolution can increase information density dramatically, which is always desired. After all, you aren't browsing this site on a screen with 640x480 resolution, are you?
- boraoztunc 6y agoIf this is happening, it will be for creatives. As Apple's first customer base, and focus for innovation and new products are always creative people; designers, video editors, 3D modelers, game artists, architects, etc... A lightweight VR tool, fully integrated with macOS ecosystem, will be presenting a new way of working. I don't think without a proper innovative way Apple will release a standart VR product, into a already troubled industry.
- fjee 6y agoI think the visual qualities of current high-end VR headsets are limited by the optical systems. 2K/eye is already reached their limitation even at the center of the view (Pimax released the 4K/eye headset, but it has wider FOV). When I read the report first, I thought 8K/eye was nonsense because it was a physical limitation rather than a technical problem. Isn't it true?
- TheEnder8 6y agoThis is an intentional leak. Apple is trying to see what the reaction is. They've got some negative press recently for pricing things a little too high (say a $1k monitor stand or $700 wheels). They're watching to see what the reaction to the rumor is. If people say 'no one would ever pay that', then they'll dial it back a bit. If the reaction is 'eh, maybe for those specs', then full steam ahead. Either way, they can just deny the leak as a rumor without any basis.
- blkhp19 6y agoSeems like a conspiracy theory. Apple has years of experience creating products that people love at all different price points (original iPhone was crazy expensive, for example). If the product is legitimately better than everything else on the market, it doesn't matter how expensive it is on initial launch.
- speedgoose 6y agoThe original iPhone was more expensive compared to other phones but it was not priced like an Apple hardware product for professionals. Between 500$ and 600$. 600$ is about 780$ in today dollars.
- acct776 6y agoAbsurd. You think massive companies don't price their overpriced things with price-elasticity in mind?!
- jimmySixDOF 6y agoFrom the article, it would have "an outward display that could be used to show content to people near you or to check information when the headset is not on your head" That detail seems a little suspect to me in this whole story
- ksec 6y agoDual 8K Resolution, I am assuming it wont be 60Hz, it will need to be 90 or 120hz. I am not even sure top of the line PC can do that today. Even Dual 4K at consistent 120fps is pushing the limit. At VR headset range with 8K Per eye is a display that is nearly 3000ppi. My guess is that 8K is the wrong figure and it is actually derived from 3000ppi. Which is similar to Varjo [1] HMD. At lastly, this is "The Information". Which means it is an Apple leak. Intentional or Not. Over the years they have been doing PR pieces and other intentional leaks for Apple. It will mostly be the same tactic as someone else has mentioned, setting consumer pricing expectation. [1] https://www.vrfocus.com/2019/02/the-varjo-vr-1-is-a-6000-headset-with-20-20-human-eye-resolution/ https://www.vrfocus.com/2019/02/the-varjo-vr-1-is-a-6000-hea...
- Simon321 6y agoThey will use eye tracking and foveated rendering to reduce the hardware requirements.
- fuzzybear3965 6y agoWhy will it need to be 90 or 120 Hz?
- aspett 6y agoYou need a high refresh rate to keep convincing your brain of the illusion. If you dip down to 60hz and below, VR sickness can be a real problem.
- ksec 6y agoMotion Sickness. You can try it with FPS. For me it is funny because the more realistic or better the graphics, a higher baseline frame rate is required. So my brain sort of work great with Counter Strike at 60 Fps, where the graphics are low Res and not any good by modern standard. Once it gets to very good / realistic level my brain sort of half interpret it as real thing. And expect "real" world motion. At this point 120fps feel so much better while 60fps cause me headache. If we are not limited by computation constraint I would want to push for even higher frame rate rather than higher resolution.
- ryanSrich 6y agoI can’t wait for a truly usable VR headset. I’ve tried them all, and they’re all pretty terrible in terms of resolution, screen door, etc. The content, and non-visual tech is all there. Everything is primed. Now we just need a headset that has proper resolution. I’m hoping Apple gets this right, clearly they understand the true issue with VR by focusing on resolution.
- scrollaway 6y agoI wouldn't say terrible, just like I wouldn't say the gameboy advance had terrible resolution. Sure, it does now, but it'll certainly get better with time and it's hard for me to think that it's the primary issue with VR. I suppose it's the issue if your expectation of VR is resolution-sensitive. But good VR apps will just treat that as a limitation and factor it in. GBA apps of the time were pixel-art, and resolution was never its "main problem" (batteries were), because you weren't using it to watch movies or something. IMO a lot of the true VR issues have been fixed by now. Pass-through, standalone wireless, baseless hand tracking, no more headaches, etc… A lot of the work that remains is incremental improvements (such as resolution, battery life, FOV, weight, tracking accuracy). I would personally like to see some very-low-latency wireless earbud support, too. Once again the Quest 2's over-the-ear system is great. The most severe issues I have with VR right now are very much not software/hardware related, but rather have to do with sweating: Band getting dirty, lenses fogging up. The fact a lot of VR apps are fitness based makes this a serious problem, at least for me. The real "true issue" of VR currently is probably the lack of apps. There's fairly few killer apps, especially on the much more restrictive Quest line. But I agree with you there's a huge potential for "retina" VR.
- ryanSrich 6y agoPerhaps it’s because I play games I expect to be more realistic in nature. When I complain about resolution I’m not talking about beat saber. I never really feel fully submerged in VR. I blame that on a few things: 1. Resolution. This is the big one for me. 2. Headset. The weight, fogging up (like you mentioned), the fact that I can still tell it’s there. 3. Sound (you mentioned part of this). Sound is important for full submerging.
- gregjw 6y agoPriced like an enterprise product rather than a consumer product, similar to Microsoft's HoloLens. I wonder how well that things selling.
- agilob 6y agoWhich Apple computer would even have a GPU to use it?
- gpmcadam 6y agoOff-topic: just want to say hi to people reading this comment thread in the future to see what we all thought about this product before it launched. Perhaps by then it'll become as ubiquitous as iPhone and you're all giggling at how naive we were for doubting Apple once again. waves
- d3ron 6y agoThat is quite cheap compared to competing professional XR headsets. Varjo XR-3: 8369 USD Canon MREAL S1: 39000 USD
- Yaggo 6y ago> The headset (which the report says is codenamed N301) will be able to display rich 3D graphics at that resolution, the report says, thanks to an ultrafast M1 chip successor and because Apple will liberally use an already-known VR technique that involves using eye-tracking to render objects in the user's periphery at a lower fidelity than what the user is focusing on. That would be superb. I could consider paying $3k for the dual 8K headset if I can skip buying a separate gaming pc for running a flight simulator. (Not to mention that 2x8K capable rig would cost a LOT!)
- Geee 6y agoProductivity strongly correlates with screen size. Immersive VR/AR experience would replace all large displays, and could allow complete redesign of a human-computer interaction. No more trying to fit windows on a screen. I think that the Apple AirPod Max is an experiment to test the structure. That's why they are so heavy.
- kozikow 6y agoAnyone I know can't stand using VR headset for more than few hours. The headset gets sweaty and I get dizzy. I don't think this is getting solved soon. And I don't see significant upgrade from 3 monitors with i3 anyway.
- arnaudsm 6y agoI hope they focused on the hand-tracking problem. AR is basically unusable without proper tracking, and it felt like most limiting thing using the MagicLeap1 and Hololens1/2.
- irae 6y agoA lot of comments here are talking about sharing a virtual office or working with VR. No one seems to note that if you cover your face with VR headset no one can see your facial expressions. The article says "more than a dozen cameras". What if this is actually a helmet? Apple called the FaceID dot matrix projector and capturing a camera before IIRC. It would be possible to capture facial expressions, and even depict the user reasonably accurately in the virtual space. I know trying to represent human facial expressions in 3D is likely a doomed attempt. But it is nice to imagine that Apple might be thinking a bit ahead.
- Ajedi32 6y agoOculus has already put in a ton of research effort into replicating facial expressions in VR. You don't need a full helmet for that, but you _do_ need at least a few cameras pointed towards your face: https://uploadvr.com/frl-multiview-face-tracking/ https://uploadvr.com/frl-multiview-face-tracking/ There's a full lecture on the subject here: https://www.youtube.com/watch?v=gpdX9jkhv2U https://www.youtube.com/watch?v=gpdX9jkhv2U
- swalsh 6y agoThat technology is being developed... but I can also tell you from experience playing multiplayer VR games, you can convey a lot of emotion simply using hand motions.
- mrkstu 6y agoThe most interesting thing about this is what it says about the work Apple has been putting into graphics hardware. Dual 8k displays that I assume are being driven by Apple graphics hardware. Lots of R&D for future M1s or discrete cards for Mac Pros.
- dahfizz 6y ago> Apple will liberally use an already-known VR technique that involves using eye-tracking to render objects in the user's periphery at a lower fidelity than what the user is focusing on. I would be shocked if this is anything but a gimmick, with all sorts of upscaling and rendering tricks. I very highly doubt apple is all of a sudden the producer of the best gpu in the world, with a wide margin. Nvidia claims their 3090 ( a $1500 card ) is capable of 8k 60fps. In benchmarks, this is only possible in certain easy to render games. The idea that apple can double that, and push a higher refresh rate for smooth vr (usually 90fps minimum) is wild.
- mrkstu 6y agoTo a point, of course, they'll use all the tricks they can. But if it genuinely isn't in the ballpark, why use 8k screens instead of 4k? They at least think they can drive enough real pixels to make the more exotic/expensive option worth choosing. Edit- and the M1, already, is by certain metrics already the best 'CPU' in the world- there isn't any particular reason to think Apple incapable, considering their access to cutting edge chip manufacturing, of doing the same with GPUs if they wanted to throw the silicon and resources at it.
- swalsh 6y ago> upscaling and rendering tricks. Just a note, Nvidia DLSS 2.0 is so good, that it doesn't really even matter if it's "just a trick". I wouldn't discount upscaling via AI.