22 ms·
Developer tools to create spatial experiences for Apple Vision Pro
- Jeff_Brown 3y agoTo paraphrase The Economist, "This device is amazing, and now Apple needs developers to figure out what it's for." https://www.economist.com/business/2023/06/06/apples-vision-pro-is-a-technical-marvel-will-anyone-buy-it https://www.economist.com/business/2023/06/06/apples-vision-...
- mpolichette 3y agoComputers were invented to speed up calculations, and yet the primary thing we use them for today is to read the news and send each other messages and memes… I think it’s totally reasonable, to expect developers to find the real use
- jacquesm 3y agoIt's the users that will find the real use.
- moffkalast 3y agoIs that why they call them users?
- jacquesm 3y agoNot necessarily. Developers and product designers assume that users are going to use their product in a particular way. In my - limited - experience in those roles users tend to find entirely different ways to use your product that you never ever would have thought of, and if you had thought of them would have had significant impact on the product itself. The resulting impedance mismatch tends to be overcome with ruthless applications of duct tape, post-it notes, bending and twisting of parts and - unfortunately - the overruling of safety devices and lock-outs.
- pohl 3y agoSo — pornography, then.
- jacquesm 3y agohttps://news.ycombinator.com/item?id=36424434 https://news.ycombinator.com/item?id=36424434
- thesuperbigfrog 3y agoA killer app might be: "Better Than Life: Las Vegas" Games, gambling, shows, and porn all in one "so immersive you won't want to leave" experience. "Disney ain't got nuthin' on this!"
- skeeter2020 3y agoSo we're supposed to get excited about our future Brave New World?
- thesuperbigfrog 3y agoThat depends on your view of VR entertainment and Las Vegas-style (adult) attractions. The Vision Pro was showcased with Disney as a content partner. While Disney has historically featured "family friendly" entertainment, there is definitely a market for adult entertainment that the Vision Pro could excel in. Is it "an exciting Las Vegas adventure in the privacy of your home" or "a lonely person in a dark room trying to escape the sadness of reality"?
- disqard 3y agoYou're the Hiro Protagonist of your own story -- Y Not Both? FWIW, my take is that this is yet another "slippery" media [0] and will mutate to whatever form brings its creators the most succe$$ [0] https://www.robinsloan.com/newsletters/visions/ https://www.robinsloan.com/newsletters/visions/
- sneak 3y ago
- furyofantares 3y agoHopefully it's as open as macOS, or at least much, much closer to it than iOS. Otherwise the options for exploration are limited by Apple.
- ohgodplsno 3y agoIt is more locked down than both.
- threeseed 3y agoNew opportunities for abuse do exist with Vision Pro. If you allowed free reign access to the sensors people could record the inside of your house/work, capture your face, fingerprints, retinal pattern etc. And again with Objective-C it's impossible to prevent private API usage unless you have some sort of App Store model which can inspect the binaries and prevent abuse. So it's ultimately going to be the same as iOS.
- Someone 3y ago> And again with Objective-C it's impossible to prevent private API usage unless you have some sort of App Store model which can inspect the binaries and prevent abuse. A alternative is to sandbox applications to prevent them from calling anything else than the official API, and to use a less restrictive sandbox for applications signed by a key owned by the vendor.
- TheBrokenRail 3y ago> If you allowed free reign access to the sensors people could record the inside of your house/work, capture your face, fingerprints, retinal pattern etc. Yes, yes they could. That's not and shouldn't be Apple's problem. That's your workplace's problem to regulate how the device is used on-site, the government's problem to regulate how it can be used in public, your household's problem on how it can be used in private, etc. The device will be inevitably jail-broken anyways, so a walled-garden isn't going to stop bad actors. Not to mention, most of the things you mentioned can already be accomplished with less expensive and much more subtle devices, like a standard digital camera. And those device definitely don't try to prevent abuse. (Imagine if your camera refused to take a picture because it thought you didn't have permission!)
- paxcoder 3y ago[dead]
- paxys 3y agoComputers had a 100% open platform from day 1. Tell me, will Apple allow a pornography app for the Vision Pro?
- basisword 3y agoIt has a web browser. You can access anything you want via that, same as the phone.
- paxys 3y agoSays who? Is Apple going to make the entire Vision SDK web compatible?
- russelg 3y agoSafari was shown in the demos.
- PeterisP 3y agoThe question isn't whether you can view the existing web content on the Vision Pro, the question is whether all of the Vision Pro SDK, sensors, and 3D functionality is exposed to the browser to enable VR-enabled webapps for the genres which Apple would disallow on their app store.
- astrange 3y agohttps://immersiveweb.dev https://immersiveweb.dev
- stemlord 3y agoNeither a web browser, nor the iPhone are remotely comparable to a general purpose computer in terms of free use
- ramesh31 3y ago
- zirgs 3y agoVideo games require A LOT of calculations.
- mentos 3y agoUnreal Engine developer here, super thrilled to see Apple spitefully choosing to only support Unity with no mention of UE. I imagine due to the bad blood between Epic and Apple over AppStore lawsuits.
- ynx 3y agoVR developer here. Politics aside, nobody should ever choose Unreal Engine for standalone VR anyways. It's clear that Epic doesn't prioritize VR, so it's more easily explained as an efficient use of resources. In concrete terms, Unreal Engine's VR support is awful; you can't get a good looking game running at high framerates on mobile hardware with it. Its forward renderer is severely lacking on mobile VR, and deferred is untenable. I don't want Unity to be as dominant as it is, but it's the only sane choice for VR. Epic is very clearly not interested in being a leader in this area.
- dylan604 3y agoHaving a disliked corporate daddy definitely has its knock on effects
- readyplayernull 3y agoWhen Unreal had those super expensive licenses in the order of +$200k most indie devs moved to Unity, so the average Unity dev doesn't have lots of resources to spend on a pricey headset and the expectation of very high quality titles. Either too few devs will ship anything or quality will be low.
- buildbot 3y agoApple _really_ holds grudges. After the Nvidia blamed them for their failing GPUs, they literally never shipped anything Nvidia ever again. There’s probably an alternate universe where metal does not exist because Apple and Nvidia became friends and just optimized cuda for macOS
- Jeff_Brown 3y agoThat's fascinating. I wonder how formalized and widespread this logic is -- did economists tell leadership, or did they just happen to organically hire spiteful leaders?
- leejoramo 3y agoIn 1981, I received a computer as a birthday gift at the young age of 13. Likely the first micro-computer in my small California town. When I took it to my Junior High science fair people were like stunned by a kid with a computer. When you turned on the computer, all you got was a flashing cursor wait for you to program in BASIC. The next year, a successful local business person asked me, if I thought in the future most people would have computers. I said yes. They replied they didn’t think that would ever happen. And they didn’t see, the need for it in their business, even after seeing VisiCalc. In less than 5 years, they had computers in thier business for Lotus123. And not long after, they had computers in their home. I have seen this pattern repeat many times. I have also seen many branches of computer tech die (amiga, os/2, palm….) But from my point of view “figure out what it’s for” is the ultimate computer hackers playground. And perhaps Vision Pro will be the first headset “worth criticizing” regardless of its success.
- adamredwoods 3y agoI feel the computer revolution was seen by many. The Vision Pro won't be nearly as explosive, if at all. It's essentially an interface for personal electronic space, and that space is being explored by hackers every where with all kinds of devices. So 'figure out what its for' is being explored by many, and doesn't have to be exclusive to Apple devices.
- tailspin2019 3y ago> When you turned on the computer, all you got was a flashing cursor wait for you to program in BASIC. > from my point of view “figure out what it’s for” is the ultimate computer hackers playground I don't have much to add to this fantastic comment.
- wil421 3y agoMy father in law was in the construction business during this time at a company building bridge spans. A supplier gave them 5 Apple IIs as a bonus for buying so much product. The owner exclaimed, throw them out computers are a fad! To calculate the bridge spans requirements it took 3 guys a 3-5 days to do the calculations, drafting the spans, and double checking everything. My father in law opened the book on basic and saw the math it could do. He wrote a very basic program to take the inputs and do the math. It took the computer less than an hour to return the results. Who knows that the future brings but I’ll be optimistic.
- thebricklayr 3y agoHonestly, I'm excited to start building AR-enhanced cooking experiences for Umami[1]. I worry though: is the passthrough reliable enough to use a sharp kitchen knife safely while wearing it? [1] https://www.umami.recipes https://www.umami.recipes
- makeitdouble 3y agoIsn't there also the issue of the device overheating ? accidental water projection ? oil projections ? Camera fogging ? The battery dying while doing something and you're suddenly blind ? I think the Apple demo of people mostly sitting on a couch is not a lack of imagination, but a pragmatic approach of how this device should be used.
- thebricklayr 3y agoYou may be right. My hope is the AVP is at least step toward something that could make potentially dangerous physical activities, like cooking, safer (e.g., by showing you the temperature of a surface before you touch it with your hands, as suggested elsewhere in this thread).
- makeitdouble 3y agoIt really makes it a pity the Hololens didn't go anywhere. I wonder how much time we'll have to wait for a device that actually aims for that space, and not a portable display like the AVP seems to be.
- basisword 3y agoI feel like even if it is good enough it’s only a matter of time until it lags and you lose a finger. Lulling us into a false sense of security is the real danger.
- Aeolun 3y agoI don’t know about you, but it’ll be obvious to me in much less than 1ms when the passthrough is lagging. You know your hand moves, so when you don’t see it move it’s incredibly jarring.
- detourdog 3y agoI’m most intrigued by the handtracking I’m hoping that ends up beig distinct…. eventually.
- Jeff_Brown 3y agoI look forward to a virtual, nothing-in-my-hands-but-I'm-still-playing-it drumset. The lack of tactile feedback will make it worse than real drums, but it'll still be fun to be able to play them anywhere.
- detourdog 3y agoI feel like the VisionPro is a demonstration of what it takes technically. All the frameworks are fleshed out. The work is done and in x-number of years it will take off or the various pieces will be absorbed into other products.
- detourdog 3y agoReplying to myself but... Imagine just the eye and hand tracking with no screens. That could be a much smaller device and one can trade the screens for an interactive environment.
- planede 3y agoMaybe Aerodrums should hire some programmers to write an app that just projects a drum set: https://www.youtube.com/watch?v=CavlglPYVvQ https://www.youtube.com/watch?v=CavlglPYVvQ edit: They already seem to have a beta VR application: https://aerodrums.com/3d-updates https://aerodrums.com/3d-updates
- Sipaliwini 3y agoYann here, Aerodrums co-founder / developer. Thank you for the plug. We're doing a Kickstarter right now for Aerodrums 2. It will have support for VR passthrough. We'll add support for Apple Vision Pro and Meta Quest 3 as soon as they make it possible (if anyone has connections to speed that up, I am interested). The project page is here: https://www.kickstarter.com/projects/aerodrums/aerodrums-2-a-new-way-to-drum-from-home-to-the-stage?ref=cmbucf https://www.kickstarter.com/projects/aerodrums/aerodrums-2-a...
- AmericanChopper 3y agoI’ve never seen an AR/VR usecase that interested me, but if this thing turns out to be a decent replacement for external monitors I’d probably buy one. I travel a lot for work and the laptop on the shitty hotel desk setup is a major drag.
- NovaDudely 3y agoI'm with you, it seems neat technology wise but the use cases I have seen just seem almost forced. I mean it is neat but I am not really wowed by the potential. In the realm of teaching, particularly with representation of physical things - this thing will be awesome. But beyond that, I don't know. The idea of a portable large viewing screen is brilliant but that it not the real main selling point of this. A decent VR head set could do something similar. In 10 years time, comments like this will either look like a prophet that could see the folly of the future... or be like all those people that dumped on the iPod and iPhone.
- mr_toad 3y ago> A decent VR head set could do something similar. Are there any VR sets & OSs that can project multiple app windows into the space around you?
- AmericanChopper 3y agoI’m not trying to dump on it, I’m just saying that as I see the product today, that’s the only thing I imagine myself wanting to use it for. That said, when the iPhone first came out I was only really interested in it to upgrade my mobile email experience, so we’ll see I guess…
- cwxm 3y agothis seems like it’ll be much higher resolution than even decent VR headsets. Also, I think the AR mode being very good is important. Not seeing the real world for too long would make me feel claustrophobic
- spaceman_2020 3y agoI can totally imagine walking into a WeWork in 2025 and seeing everyone in the hot desk area wearing one of these instead of their tiny laptops.
- wslh 3y agoI feel the same with the Meta devices but I think what the journalist misses is the strategy. Meta completely failed in the strategy, their store is empty of AAA offerings. This is not bad luck it is a blatant incompetent strategy from Meta. It is in the business book. I assume Apple has a strategy, it could fail? Obviously, but they are doing what is right. When the iPhone 1 launched there were many hiccups but in a short period of time. I agree that initially this product will not sell many units. A sci-fi thinking also tells me that this could improve many industries with completely new interactions with the world. I see this more a B2B product than B2C.
- chunkyguy 3y agoApple's strategy has always been to go 100% in and don't look back. Eventually people assume if Apple is investing so much into this new thing, they must have a plan. So a few adventurous devs and users get onboard. Apple marketing team uses that as the bait to bring more people onboard.
- luxuryballs 3y agoguess they’re going to have to send me one so I can get crackin
- SkyMarshal 3y agoToo many business/econ types have difficulty envisioning what new tech may be good for. Be it early computers, or the internet, or now this, they seem to be bottom-line people with little imagination or vision.
- Jeff_Brown 3y agoI feel the opposite way. The crowd will invent things an individual cannot anticipate. To believe otherwise is a failure of imagination.
- giancarlostoro 3y agoI assume the end goal is something like Cyberpunk 2077, where you have a HUD always, so if you go get a cup of coffee whilst working, you can, and still fidget with things as you do, or what have you, maybe you're about to go to lunch and miss a message that could prevent one of the worst outages of your company, or whatever, I'm just trying to see the net good that people will figure out over time if its done correctly, but there's likely to be something people will come to enjoy about it. I would also assume you would want as many RDP type of applications on this platform as you possibly can have, and if Apple is not pushing companies that make RDP apps to be on their platform or other useful app makers onto their platform, then they're really dropping the ball early.
- thih9 3y agoI remember the hype about ARkit and that it has been presented as a general purpose UX pattern, when in practice I saw it get popular only in specialized areas. I’m curious how spatial experiences will fare. Also, I don’t like that the gesture tracking in the dj app video demo seems laggy, especially when moving the fader.
- threeseed 3y agoFrom people who've used the device the gesture and eye tracking is flawless. But how those SDK events gets translated into UI control movement is obviously going to be dependent on each developer. And I suspect the variance in quality will be much greater than with iOS given everything is in 3D.
- ctvo 3y ago> But how those SDK events gets translated into UI control movement is obviously going to be dependent on each developer. And I suspect the variance in quality will be much greater than with iOS given everything is in 3D. Why is the variance any different? You're provided a tuple representing where the user is looking similar to the location of their fingers? You're provided a hook for when the user clicks (with their fingers) in various ways? This all relies on Apple to accurately capture those inputs at the device and OS level to provide it to developers, which they've apparently done a very good job at. The abstractions on top of this don't feel very different than those that exist on any other platform.
- threeseed 3y agoI built a number of iOS apps in the early days of the SDK and I remember it took a while for the community to learn the best techniques to efficiently render complex tables in scroll views. The same thing will happen here except that you have the additional issue of learning how to efficiently render 3D assets in response to user events. After all most developers do not come from a gaming/VR background.
- pornel 3y ago
- jacquesm 3y agoI feel very vulnerable with a device like that on my head. I've been playing with VR hardware in various iterations since the mid 80's and I haven't seen anything yet that managed to get me to overcome that feeling. As well as nausea due to lag. I wonder how this one will do but at the current price point it just isn't all that interesting, it also reminds me of the way Google Glass was introduced and hyped and what eventually became of it. But Apple tends to have a much better product strategy than Google.
- ianlevesque 3y agoThe form factor of the Quest Pro helps with that quite a bit, where you're essentially wearing it like a hat, and the sides and bottom of the device don't contact your face or seal out all the light. There are notorious stories of people punching through walls or TVs playing VR games, but being able to see the room in the periphery is both less distracting than you'd think and gives you enough spatial awareness to not really have those issues.
- withinboredom 3y ago> There are notorious stories of people punching through walls Bahaha, reminds me of the time when I first got the PSVR and my friend comes over. We're playing an FPS demo that came with it (PS Worlds? I think). It's this scene where you're in the passenger seat of the car, shooting up people on motorcycles that are shooting at you. Anyway, I'm standing off to the side watching the TV when out of nowhere, my friend punches me in the face. I happened to be standing exactly where the NPC driver was sitting in the VR world and my friend wanted to try punching the character.
- germinalphrase 3y agoMy instinct is that this entire product is basically a dev kit for whatever Apple wants to release in 10-15 years. Get something high quality in peoples’ hands and hope the use case bucket trickles full.
- rvz 3y ago
- dagmx 3y agoI'm very excited to see what people will be developing. The feedback from early press has been incredibly positive from just first party applications, but third party apps are where a lot of things will come up that Apple themselves likely haven't thought of.
- withinboredom 3y ago> third party apps are where a lot of things will come up that Apple themselves likely haven't thought of. Until they sherlock it. Honestly, I'd be terrified to come up with something that became too popular in their app store.
- dagmx 3y agoThere’s also nothing stopping some third party undercutting your app as well. I’m of the mind that it’s a risk worth taking , because it’s an opportunity that wouldn’t have presented itself otherwise
- withinboredom 3y agoI meant once you become somewhat popular, it's got to be terrifying. Not necessarily that it's terrifying before you start. When you first start out, there's a billion things happening and this isn't one of them.
- dagmx 3y agoBut again, in that time you’d have made a ton of money. Being too terrified to do something because you might be too successful is just missed opportunity
- withinboredom 3y ago> in that time you’d have made a ton of money. And established a life-style + employees as well. If it were to suddenly vanish, from experience, you can basically go bankrupt in a matter of months. Maybe its because I've been there (not sherlocked, but a competitor undercut us with unsustainable margins, in fact, they went out of business shortly after we did), and rode that roller coaster. I wouldn't do that again, or go anywhere near that situation. Someone who hasn't been there, would probably be much more willing to take that risk.
- bee_rider 3y agoI wish as a developer tool Apple would let people run Vision Pro apps on an iPhone in something like Google cardboard. It would be an awful consumer experience of course, but it would be nice just to try and get ready for the real devices.
- jml78 3y agoPart of the magic is the eye tracking and exterior cameras tracking hands. Without those, I don’t see how what you suggest would be very helpful
- bee_rider 3y agoSurely not every app will use the hand and eye tracking. Let the user attach a pair of mouses (one for eyes, one for hand). > Next month, Apple will open developer labs in Cupertino, London, Munich, Shanghai, Singapore, and Tokyo It can be pretty janky and still be more convenient than traveling to one of six cities.
- leodriesch 3y agoEye and hand tracking are supposedly the only way to interact with the device, so unless your app is not interactive at all, you will use them.
- idle_zealot 3y agoEye tracking and hand gestures are the default way to interact with the device, but it also supports pointing and even normal cursor navigation via a paired trackpad or mouse in the interest of accessibility.
- lolinder 3y agoI'm assuming that in the long run the idea is that if you're developing for the platform you own one (or your company does). The labs are a bridge for the first batch of developers, not Apple's long-term plan.
- hbcondo714 3y ago> apply for a developer kit starting next month Mark your calendars!
- javajosh 3y agoI'm not joking when I say I want to write software for this thing that can help you get the most out of a psychedelic experience. I think the combination could be powerfully positive (or negative, of course).
- gwill 3y agoit'd be interesting to shape the experience based off of biometrics from an apple watch as well as pupil dilation/eye movement if possible.
- javajosh 3y agoyes, ideally it would be generative and reactive. There was a throw-away idea at the end of Stephenson's "The Diamond Age" that altered the appearance of a woman based on your reaction, to make her more and more attractive to you...this idea generalizes in some interesting ways. Even better if there existed a small affordable fMRI machine or at least a way to measure alpha, delta, theta waves etc and maximize those.
- scyzoryk_xyz 3y agoAt the same time terrifying, I’m happy that they mentioned they’re closing off that area from developer access. I don’t want the app to know where I’m looking, or how I’m looking
- mensetmanusman 3y agoYeah, they would get pretty bad press if people were to find out it's being used by the Saudi family for interrogations before bone sawing.
- watmough 3y agoI have no doubt that Jeff Minter will be right on that ... https://www.polygon.com/23613576/jeff-minter-profile-akka-arrh-atari-llamasoft-arcade https://www.polygon.com/23613576/jeff-minter-profile-akka-ar...
- bagels 3y agoApple expects to sell 150k units next year. I'm sure there will be a couple of popular apps, but beyond those couple, what is the financial incentive to develop for it?
- diegocg 3y agoThe users of these glasses will be rich people who love to spend money on new shiny things
- izzydata 3y agoIf they sell 150,000 units somehow and it only has 2 apps on the market then you could expect an extremely high percentage of those people to buy your app.
- devsegal 3y agoCan you share where you got that number from? Is it in one of their recent keynotes ? thanks
- bagels 3y agoYeah, I googled it, maybe the source isn't reliable, sorry.
- tcmart14 3y agoI heard closer to 600K in sales. But I do think, regardless of the actual number, Apple doesn't plan to sell millions of theses. At least not this iteration of the device. Which is something I've seen parroted quiet a bit.
- jonplackett 3y agoReally curious how the simulator will work for this!
- rafark 3y agoCrossing fingers for this to take off. There’s a lot of potential applications for a device like this.
- canogat 3y agoPiano lessons. I’m genuinely excited for piano lessons on this thing.
- jnsie 3y agoSynthesia integration would be super cool
- dylan604 3y ago$20 worth of psilocybin would work on a shoestring budget compared to the $3500 vaporware
- jnsie 3y agoI want you to know from the bottom of my heart that I love your comment and didn't downvote :-)
- throwuwu 3y agoI could be wrong but I don’t think mushrooms will help you learn piano
- drewbeck 3y agoSynthesia [0] [0] https://synthesiagame.com/ https://synthesiagame.com/
- furyofantares 3y ago
- jedberg 3y agoI'm not skilled enough to do it myself, but I can't wait for the AR apps to help with physical skills, especially things like art. I do ceramics on the wheel, and having an app that can show me techniques, highlight areas that are thin or weak, critique my technique in real time, and so on, would be something I would definitely pay for. Same with painting. I can't wait to see the AR apps!
- dylan604 3y agoDo you have to tell it the style? Like if you're trying to do a portrait, but it's in Picasso mode vs Michelangelo mode, does your portrait have a funky face
- jedberg 3y agoLol that would be an awesome feature!
- astrange 3y agoBoth of those things seem like they have a chance of splattering on the cameras.
- jedberg 3y agoI'm sure there will be a thriving ecosystem of protective accessories.
- astrange 3y agoEh, I just mean it's hard to do AR if you're getting paint on the AR camera. I guess you could just keep swapping protective covers. Although it might not matter - even cracks on a camera lens affect the picture less than you'd think, because they're out of focus.
- jedberg 3y agoOr just wipe it off.
- deleted 3y ago[deleted]
- Kydlaw 3y agoI may have missed this information, but did they announce somewhere the configuration required to be able to develop applications on this platform? I'd really like to try out their SDK, but without knowing the minimum requirements, I don't really dare invest in a Mac (knowing that I won't be able to add RAM after purchase, for example).
- etchalon 3y agoYou can develop for the platform on any Mac, including their lowest end M2 products like the Air or Mini. The device itself is running the base M2, so there's reason you can't right code using a device with the exact same chip. I would recommend at least 16G of RAM, with 32 being more future-proof. Rumor is the device has 8 on-board.
- kitsunesoba 3y agoIt’s basically the same stack as on iOS/iPadOS, so it’s going to have the same requirements.
- woeirua 3y agoI think it's very important for people to get out of the HN bubble when discussing this. $3500 is just way too expensive for mass customer adoption. Meta is struggling to get customers to adopt the Oculus hardware when its an order of magnitude less expensive. I can't see why _any_ developer would sink tons of money into building custom apps on this platform when there will be less than a few hundred thousand users next year.
- EwanG 3y agoThe presumption, from an investing standpoint anyway, is that working on this version will give you a first mover advantage for a V2 in two years that will have slightly upgraded chips, similar display, and cost half as much.
- woeirua 3y agoHalf as much is still no where close to where they need to be to get mass market adoption.
- katbyte 3y agoApple is selling iPhones for what, 1500? That’s nearly half 3500
- BizarreByte 3y agoThe average person is buying an iPhone under a 2-3 year contract. Most aren't being bought outright.
- SirSourdough 3y agoI don't really understand this assessment. Half as much is $1,750. That's really not much compared to what people are willing to pay for Apple devices. Basically the price point of an iPad Pro, and I think the potential of the Vision Pros is much higher than the potential of the iPad. It's just a matter of whether they can realize some commercial use-cases like with the iPad. The Vision Pro is marketed as a device with the potential to replace or significantly augment a laptop and/or TV for a lot of users (I understand there are presently some asterisks needed there). And that's assuming no other novel, high value uses emerge. Apple sells something like 7 million MacBooks per quarter. Many of them are well more than $2000. I don't think a $2,000 price point is a crazy barrier if the device is able to live up to what it could be.
- mikenew 3y agoI actually think the killer feature for this thing is already there: a hands-free, mostly passive consumption device that can seamlessly switch from full attention entertainment (or work) to partial attention consumption. I think it will work a bit like wireless headphones with audio passthrough. I can sit at my PC and hear audio from whatever I'm doing, but I can also get up and move around and still hear that audio. The audio passthrough, even though it's not perfect, is easily good enough for me to hear my environment and even carry on a conversation without having to take them off, and I can pause whatever music or podcast or video I'm listening to just by pressing a button on the side. I think the headset will provide a similar experience in that you can push whatever random YouTube video you were watching out of your direct line of sight, and then get up and go make yourself lunch while you're still half paying attention to it. Not only that, but you can interact with it using your eyes + minimal hand gestures. The really intense, fully-present experiences (like gaming on a current headset) will probably still happen, but I think most people won't be spending much of their time there, similar to how the total amount of time spent in modern, intense, realistic gaming is tiny compared to how much time people spend scrolling feeds and mindlessly consuming content.
- alfonsodev 3y agoI thought so but what about the camera position not being same as your eyes, would you be able to drink from a cup of coffee and coordinate? Or have a similar experience to the living with lag video, this time no because time lag, but eye hand not coordinating. https://youtu.be/_fNp37zFn9Q https://youtu.be/_fNp37zFn9Q
- causality0 3y agoYou don't use your eyes to drink from a cup of coffee, unless it's to check how much coffee is in the cup. Eyes are not required for proprioception.
- ladberg 3y ago> Eyes are not required for proprioception. No, but they will mess with and override proprioception. I've used the Vision Pro and the first time you try to take a drink with it you'll probably miss your mouth. I think the main reason is that you see the cup coming towards your slightly offset "eyes" and your body automatically adjusts to match. I think if I had closed my eyes (I didn't try that) I would have done better.
- charliea0 3y agoBoy the this timeline is turning out to be very cyberpunk. I wonder how long before people start bumping into lamp posts because they are distracted by one of these.
- dahwolf 3y agoQuite the uphill battle for a developer. This is different territory compared to marginally useful 2D app that millions of developers produce. To make a believable virtual/3D experience requires enormous investments if you don't want it to look like a video game from 25 years ago. It's quite telling that Apple rushed through the 3rd party demo session at the event, as every example looked terrible. As terrible and useless as 99% of AR apps produced thus far. I would suspect that only giants like Disney could produce a "killer app" experience that woes people and make this worth the money and discomfort. And on top of that, yes, lots of developers will produce what are basically 2D apps where they take an existing app and project it in space, possibly showing multiple sub screens. Slightly more useful if done well, at best. Financially likely the only realistic scenario for most developers but it also cheapens the appeal of this device. Not to mention that you need to apply way more real world scrutiny to possible scenarios. As an example, somebody suggested a cooking app. To solve what problem, exactly? Cooking is instructions and timers. Yet with this device one can project more information. What information, exactly? Cooking requires free movement, to grab items, throw things in the trash, but here you are with a thing strapped to your head with low visibility. Possibly wired as you need to be thinking about battery during a long cooking session. Maybe you're cooking with two people, as couples sometimes do, then what? Countless real downsides, merely theoretical upsides. Don't get me wrong? Will the tech elite embrace it and will a few influencers rave on about this cooking app on their channel? Sure. But that's not my point. My point is that you need convincing apps with tremendous added value to offset the price and discomfort of this device. Without that, it will be solo movie watcher pro.
- dahwolf 3y agoI want more of those downvotes. VR developers are an especially angry bunch as they believe VR is awesome, we're just too ignorant to understand it. We get it just fine, VR sucks.
- allenu 3y agoI don't know about VR developers being angry. I'm a VR/AR skeptic too and I'm surprised at the seemingly overwhelming optimism about Vision Pro from commenters. I think maybe it's the result of a large number of people who either enjoy Apple products (I'm one) and a large number of people who want VR/AR to succeed. I agree that there are use cases that when you think them a through a bit just aren't as practical as one thinks, such as the cooking scenario. Walking through scenarios in your head and thinking through the logistical issues with using such a device is a good way to ground yourself in some of the VR hype, in my opinion.
- elforce002 3y agoI'm hyped, ngl. I'm adding SwiftUI and Reality Kit to the list of things to learn this 2023. Better be prepared for 2024 when this thing goes mainstream.
- deleted 3y ago[deleted]
- MicropenisMike 3y agoIn a world where headsets are as ubiquitous as smartphones, what happens to social media like Discord, or Reddit?
- Aeolun 3y agoOh yeah, spatial angry birds!
- itsuka 3y agoUpdated resources on June 21st: - SDK on Xcode 15 beta 2: https://developer.apple.com/download/all/?q=xcode%2015 https://developer.apple.com/download/all/?q=xcode%2015 - Developer documentation - visionOS: https://developer.apple.com/documentation/visionos/ https://developer.apple.com/documentation/visionos/ - Plan your visionOS app: https://developer.apple.com/visionos/planning/ https://developer.apple.com/visionos/planning/ - Human Interface Guideline - Designing for visionOS: https://developer.apple.com/design/human-interface-guidelines/designing-for-visionos/ https://developer.apple.com/design/human-interface-guideline... - Apple Design Resources - visionOS: https://www.figma.com/community/file/1253443272911187215/ https://www.figma.com/community/file/1253443272911187215/ - App icon tool (Parallax Previewer): https://itunespartner.apple.com/assets/downloads/Parallax%20Previewer.dmg https://itunespartner.apple.com/assets/downloads/Parallax%20... - visionOS Beta Release Notes (new features, known issues): https://developer.apple.com/documentation/visionos-release-notes/visionos-release-notes https://developer.apple.com/documentation/visionos-release-n...
- theptip 3y agoIf I follow correctly, it seems they removed the $99 developer registration fee? Smart move, to maximize the number of app ideas generated for the launch.
- dannyw 3y agothey’ve removed that for a while if you just want to develop locally, and are OK with apps expiring every 7 days unless you republish with an online check in. You still need to pay for more advanced features, and to publish your app.
- paxys 3y agoDespite people always posing this as a “chicken and egg” problem, in reality there is never going to be a fledging developer ecosystem without first getting users on the platform. You can see the same in all of Apple’s own past product launches, iPhone included. Unless they can figure out a way to get the Vision Pro into the hands of millions of active users, I doubt they will get big time developer effort behind it.
- prawn 3y agoIf you are an early developer for a platform, you get an outsized share of users that can be a reasonable advantage. We developed for AppleTV when it was first opened to general developers and were able to rank well in a key category by adapting a previous app. Admittedly, that was a $x00 product rather than $3500, but I think they'll get enough of an audience (developers, wealthy, enthusiasts, etc) for developers to get in front of. Maybe not worth it for AAA titles, but being one of the only solid apps in a category, or simple games in a genre.
- SamuelAdams 3y agoWindows Phone had the same problem. Not enough users because there were not enough apps because there were not enough users.
- pzo 3y agoThey support all iOS and iPadOS apps - that's enough to be useful initially for the use cases they were presenting. All developer will have to do is probably just tick on one box. Same with all Unity games. Only VR style games/apps will need more integration but since It's all based on ARKit, ARKit apps or Unity apps using ARFoundation won't require much work to adopt for vision pro.
- jedharris 3y agoThe top comments miss the big driver for the first couple of years: business applications that are remote and/or collaboration heavy. I think these can easily drive more demand than Apple can fulfill in the first few years. Such applications are very price-insensitive. Also the military training applications are potentially enormous. The cost reduction in training with simulated environments is huge, there's already a lot of DOD investment in this. I don't know how quickly this will ramp up, though.
- dmix 3y agoYeah the amount of people comparing this to $1000 gaming headsets you have to plug into a $2k computer claiming it’s way too expensive for the (current) market really seems to be missing the point. I don’t think Apple spent any time at all talking about games during the launch. This is a general computing device not simple an entertainment one. Nor is it a mass market product like a Quest 2 (yet). But yeah $3.5k is not a lot to spend for businesses either. I could see every music producer wanting one as soon as some production software gets VRized. And some novel synth UIs get invented. $3k isn’t much in the Music gear world.
- heinternets 3y agoIf it makes people nauseous like existing headsets, it's a non starter for the majority of people.
- jedharris 3y agoI'm surprised that none of these comments address the completely new interaction paradigm -- eye tracking + hand gesture tracking. Previous devices couldn't track accurately enough to provide high quality user interaction this way. All the ones I know about required holding controllers. If this is successful it will be the first completely new interaction paradigm since the mouse. Of course so far interactions are mapped down to hover and click because existing software can then run, but the UI tools aren't limited to that at all. I'd expect that in five years we'll have a completely different sense of interaction with content through Vision (or Vision like products). (For those who want to quibble -- Touch is somewhat new relative to the mouse, and multi-touch gestures are truly new but very limited. But the design of apps and user interaction hasn't significantly evolved relative to the mouse-bound era.)
- Frost1x 3y agoEye tracking and hand gesture tracking are hardly new, even used in conjunction. The issue is, as pointed out, none do it well (accurately) enough to be of quality use but progress has certainly been made over a few decades. I've not used the new Apple device but I'd be surprised if accuracy is still good enough. I'll be happy to be wrong but I suspect there's still a fair amount if work needed to get us to a point your average user is happy with. We already complain about touch devices like touch screens which are steps above anything current gesture and eye tracking I've seen can currently do (to my knowledge). People still want physical high precision keys, knobs, button and physical devices like controllers. Tactile feedback is part of it but the accuracy/precision is a larger part.
- usehackernews 3y agoCompletely true. What I’m most excited about is to see what people do with the UX. We are no longer confined to windows that scroll up, down, left, and right. Application’s now have depth, and the spatial concept will mean the way we view and interact with applications will change completely. I’m very excited for this.
- taeric 3y agoThe PS5 also does the eye tracking really well. It still sucks compared to using controllers. The tactile feedback of the buttons along with the very subtle activation motions is a touch beyond gestures. (In particular, they work together. Without the tactile feedback to know you have released a button, it is hard to reengage it fast enough.)
- zmmmmm 3y agoI'm really interested to see how high level the support is for "spatial computing" is in the APIs they are offering. This whole thread is full of people wildly speculating about applications which, without amazing platform level support are each going to be a small miracle in state of the art computer vision applications. Can they offer full 3d image detection / segmentation to give you a full spatial model of the user's environment? If not, a lot of people are going to be sorely disappointed by the amount of computer vision expertise required to get even basic apps they are envisioning to work. On the other hand if Apple does offer this type of platform support, it will be quite revolutionary. Meta has offered a range of spatial computing APIs for a while but they have been slow to take off. The Quest 3 should really push this along though. It will be fascinating to watch the two platforms compete on this front.
- jlmendezbonini 3y agoCan you elaborate why you think that the Quest 3 can push this along?
- zmmmmm 3y agoSo far Meta has published a whole bunch of spatial APIs including scene detection, spatial anchors, plane detection etc. [0] They are far ahead of Apple in many of these respects, but what they haven't had is a device that made this attractive to actually develop for in any meaningful way. Quest Pro lacks a depth sensor and has too small a market presence to attract a lot of developers, while Quest 2 has ugly, black and white low resolution pass through. So Quest 3 will be the first spatial computing device the world has ever had access to that is available at mass market price (<$500) with depth sensor and high quality pass through. It will finally be worthwhile for developers to build mixed reality apps targeted to regular consumers. https://developer.oculus.com/documentation/unity/unity-spatial-anchors-overview/ https://developer.oculus.com/documentation/unity/unity-spati...
- pzo 3y agoBased on what you mentioned all of those are also available in ARKit or Vision API: plane detection (vertical and horizontal), anchors (both local and geolocated), 3d scene reconstruction, 3d object reconstruction, custom planar markers, qrcode & barcodes, 3d human pose skeleton, 3d hand skeleton, face landmarks mesh, world tracking (SLAM), text detection. Haven't checked Meta APIs but it doesn't look for me as far ahead of Apple.
- BeenAGoodUser 3y agoI read somewhere that photo/video capture wasn't available, is that true?
- drewbaumann 3y agoCorrect. It will show a black feed for the “back” camera. The “front” camera can show the hologram of you if I’m not mistaken.
- tjmc 3y agoA couple of ideas I'd love to see... - Night vision app using the truedepth and lidar sensors - Drone/robot/telepresence HUD. It would be incredible with stereoscopic cameras
- taeric 3y agoOh wow, I had assumed that night vision goggles would already cover the night vision idea more than fine. And under the budget of this. Night vision things are expensive, though. Impressively so. The drone things, amusingly, are already price competitive. At least once you factor in the cost of the drone.
- charcircuit 3y agoHas the headset been confirmed to work in the dark? It would requires apple to have flood lights on the headset to light up the environment no that the cameras can see.
- pzo 3y agoIt has in front both lidar and truedepth camera - truedepth camera has IR flood flights and IR cameras but provide resolution of depthmap 640x480 at 30fps. Unfortunately raw IR camera video stream is not available for 3rd parties so you could only render this VGA depthmap heatmap style.
- dontupvoteme 3y ago>- Drone/robot/telepresence HUD. It would be incredible with stereoscopic cameras That's interesting, I could see this as part of the security task force for world leaders and such, some extra guys with virtual eyes spread all around and can watch people around corners.
- jatins 3y agoIt's interesting how just switching the positioning of headsets from use cases like Horizon world / second life games to practical uses like DJing , watching movies immediately makes the device seem so much more useful and something I can see myself buying.
- sizzle 3y agoDoesn’t the HoloLens do most of these demos in the article already?
- pavlov 3y agoI don’t suppose Apple has any plans to support the open standard that every other hardware maker supports: https://www.khronos.org/api/index_2017/openxr https://www.khronos.org/api/index_2017/openxr
- jsheard 3y agoDon't hold your breath on that one https://docs.google.com/document/d/1F6ns6I3zs-2JL_dT9hOkX_253vEtKxuUkTGvxpuv8Ac/edit https://docs.google.com/document/d/1F6ns6I3zs-2JL_dT9hOkX_25... > Apple is not comfortable working under Khronos IP framework, because of dispute between Apple Legal & Khronos which is private. Can’t talk about the substance of this dispute. Can’t make any statement for Apple to agree to Khronos IP framework.
- cmelbye 3y agoI'm confused about this and related comments (it doesn't support Unreal, etc.) There is probably something that I'm missing here. What is technically preventing Unreal/OpenXR/etc. apps from running on Vision Pro?
- dns_snek 3y agoFrom what I understand, OpenXR is a common interface that needs to be implemented by the headset manufacturer. If Apple doesn't do this, OpenXR apps won't work. Before OpenXR every headset had its own interface. Valve and descendants have SteamVR, Oculus has its own runtime, Microsoft and descendants have Windows Mixed Reality. Games/Apps targeting these platforms used to have to implement each one of these interfaces separately if they wanted to support that family of headsets. OpenXR shifts the responsibility onto the headset manufacturer, from my limited understanding. edit: I don't understand why this is being downvoted? If there is a technical detail I got wrong, I'd welcome an explanation rather than Reddit-esque downvotes.
- t8sr 3y agoThis is the correct answer, despite being downvoted. What’s technically preventing OpenXR apps from working? Vision Pro doesn’t implement OpenXR.
- andybak 3y agoI don't think there's a single comment here that's about the developer tools. It's all just people debating the merits of the Vision Pro and XR in general. Again...
- pavlov 3y agoIt’s pretty boring because it boils down to “I can totally imagine myself doing X with a headset” and “I can’t imagine myself doing X with a headset” — the operative word being “imagine.” I’d love to read a comparison between visionOS SDK and OpenXR from someone who has actually used the latter. I gather that OpenXR is lower level, but what exactly does that mean for an app developer? How much more work would it be to build a “spatial experience” cross-platform with OpenXR? What would the compromises be for both approaches? Would it be feasible to build an engine that runs on both platforms?
- Lorkki 3y ago> I gather that OpenXR is lower level, but what exactly does that mean for an app developer? Mostly that they won't be using OpenXR directly. It's a standardised layer that lets many kinds of tools and libraries make use of the same hardware.
- pavlov 3y agoWell, ok, but since the tools and libraries don’t exist yet… Instead of waiting for somebody else to build middleware and hope it will be good, what would it look like today to design and implement an app that works on both visionOS and OpenXR? That’s a question that I find interesting. Even if I don’t end up building such an app, it would illuminate the differences between Apple’s SDK and the rest of the industry.
- jimmySixDOF 3y agoA lot is still just becoming more clear now the SDK is here today but as usual there are definitely fine print gotchas. There are waay more restrictions in the MR Shared space mode so whatever (Unity/webXR) exports only to RealityKit for rendering with tight Apple conditions. In Full VR mode without Passthrough you have full control so custom shaders but no gaze and a 1.5m motion range limit. The MR mode itself has two flavors single or multi app modes with some tradeoffs like no hand joints with multiapp. Hand Joints are non OpenXR standard so need translation to be crossplatform anyway. And so on. All that said it's great so many experiences can port and there is a lot more interest in WebXR now hopefully WebGPU will fall into place too and it will be interesting to see what we can do with the Internet in 3D.
- rickdeckard 3y agoThanks all for sharing their opinions on what's great/bad about Apple or VR in general. Anyone here with actual experience with visionOS SDK and its API's, able to give an insight on how it compares to other platforms? I imagine there's a world of interesting details and differences, considering that the device is designed around a single, very powerful compute specification...
- ramraj07 3y agoGruber compiled some actual devs and their experiences but am unable to direct link to the post - it’s the top post on daringfireball.net now.
- macintux 3y agoYeah, fascinating glitch. This link may eventually work. https://daringfireball.net/linked/2023/06/21/visionos-apps https://daringfireball.net/linked/2023/06/21/visionos-apps
- BaculumMeumEst 3y agoIt's weird how on one hand, Apple is pushing the envelope with graphics rendering, but they have been funneling absolutely everyone into Swift for years. They recently released metal-cpp to help developers that have existing C++ codebases bring them to apple by dropping in header files that bridge to Objective-C, it's hacky and unwieldly but kind of works I guess. It's especially weird to me considering how nice Metal is to work with, but neither swift not some hacky ObjC/C++ approach seem suited to the task of pushing the envelope of graphics rendering to take full advantage of this hardware. Am I off base here? Honestly, I hope this takes off is really successful, and kicks off enough investment in competitors so that I can hack on cool stuff in another software ecosystem.
- drawkbox 3y agoApple merely added these libraries to an already existing system to better link Swift to C++/Objective-C++. Objective-C/C++ and C/C++ work well together and always have, it is pretty much required as nearly all game engines (even Unity/Unreal) are C++ underneath just like all apps. Apple did recently add better support for mixing Objective-C++/C++ to Swift which was more difficult before. [1][2][3] Swift to C++ had more leaps prior to recent updates though it was still possible. Really it just handles the Swift to Objective-C++ to C++ link better. Objective-C++ has been used since iOS inception to link C++ game engines to Objective-C. All you have to do is compile with g++ or other and typically files with .m are Objective-C only and files with .mm are Objective-C++. Objective-C/C++ and interop with C/C++ actually works really well and every single game engine on the store (pretty much ever game) uses Objective-C++ to link them at a minimum. We used lots of C++, Objective-C and even Objective C++ (g++ mixing Objective-C + C++, connecting to C++ engine) in a custom game engine that worked on mobile for lots of shipped titles. It is powerful and fun. People have been mixing assembly, C/C++, Objective-C/C++ since the 80s. These technologies so close to the metal and machine code actually work better together than most "modern" frameworks/systems. A sample of early game engines using this link is Oolong from 2008ish, that was used on an early Quake port and many game studios had something like this for custom engines to get them to the iPhone/iPad/etc. [4] Fun fact: Objective-C was created before C++. Objective-C all they way back to 1981 but officially 1984. [5] C++ all the way back to 1982 but officially 1985. [6] [1] https://www.swift.org/documentation/cxx-interop/ https://www.swift.org/documentation/cxx-interop/ [2] https://developer.apple.com/documentation/Swift/UsingC++APIsInSwiftAndSwiftAPIsInC++ https://developer.apple.com/documentation/Swift/UsingC++APIs... [3] https://developer.apple.com/videos/play/wwdc2023/10172/ https://developer.apple.com/videos/play/wwdc2023/10172/ [4] https://code.google.com/archive/p/oolongengine/ https://code.google.com/archive/p/oolongengine/ [5] https://en.wikipedia.org/wiki/Objective-C#History https://en.wikipedia.org/wiki/Objective-C#History [6] https://en.wikipedia.org/wiki/C++#History https://en.wikipedia.org/wiki/C++#History
- usrusr 3y agoExemples remind me of when Encarta was the future. In hindsight, yeah, encyclopedia are digital now (losing the plural in the process, unless we count language versions) and optical data distribution media have been ubiquitous for a while, but Encarta wasn't exactly the future of Microsoft.
- al_be_back 3y ago[dead]
- fnord77 3y agoapple vision pro isn't an iphone moment we're still at the apple newton stage maybe in 10 years we'll be there
- rob74 3y ago> Apple Vision Pro has an all-new App Store where users can discover amazing apps and content. As an ex Daydream (R.I.P.) user, the app store screenshots look oddly familiar. Maybe Google can resurrect Daydream (probably under a new name, or just call it Daydream Pro?) and reuse some of their sunk investment as software for an actual VR/AR headset rather than a thingie where you have to insert your phone?
- mderazon 3y agoI loved that device i don't get why it was discontinued
- nazgulnarsil 3y agoExposure therapy would be huge. Existing exposure therapy apps have been run by people without phobias themselves and have shot themselves in the foot by advertising themselves with big vivid pictures of phobia scenarios guaranteeing that their target audience avoids them.
- joshspankit 3y agoWhoever releases the first truly compelling AVP app is going to make a lot of money. They could even charge $50 one-time or $50/yr. If it’s compelling enough the “I just spent $4k” demographic is going to see the price as a mere triviality.
- atentaten 3y agoHave the solved the problem with people feeling dizzy or sick when using this type of device?
- 19h 3y agoSomething I find hilarious is that the visionOS disk image is called “xrOS” (the name that leaked before the keynote).