12 ms·
VisionOS developer docs and Vision Pro SDK
- samsolomon 3y agoAlso, the VisionOS component library is available in Figma Community. Was playing around with it last night. It's a pretty comprehensive library. https://www.figma.com/community/file/1253443272911187215 https://www.figma.com/community/file/1253443272911187215
- nailer 3y agoI’m not an apple person but I do think the eye tracking to focus / pinch the air to activate combo is very natural and significantly different to what meta, HTC etc are doing. I think this might be the turning point for AR/VR.
- cubefox 3y agoIt seems to work great for 2D control where it works similar to a mouse or a touchscreen. But for 3D control outside floating screens it is a bit unclear whether it can compete with a proper 3D controller.
- no_wizard 3y agoNote: I'm speculating here, not saying Apple Vision Pro can do any of this. If you could track hand movement 1:1 enough that interacting with a 3D space was as natural as it would be as if it was actually in front of you, the problem is definitely a solved one at that point. If Apple manages to do this at any point in the lifecycle of this product line, it'll be a significant breakthrough for this type of computing / experience
- ericlewis 3y agoAll controls for visionOS also have something called "direct touch" where if you reach out and press the button the button gets pressed! Further, you can absolutely make 3D objects able to be grabbed, thrown, resized, etc. and it is actually pretty simple to do.
- XorNot 3y agoI'm very skeptical this is going to be nice to use. People barely tolerate touchscreens (i.e. phone yes, laptop - maybe, desktop - no). This is a button which has no physical presence at all.
- cubefox 3y agoYeah. On a touchscreen you get at least a tactile resistance of the feeling of touching something rather than the air, although you don't feel whether you touch the virtual button or not, or when you are successfully pressing it. On hand tracking you don't feel anything at all. Controllers have a large advantage here. Maybe Apple deliberately decided against including optional controllers, to make it clear that they are aiming at AR, not VR gaming. But even in AR the lack of tactile feedback could be jarring.
- xsmasher 3y agoApple has a 3d keyboard that you can reach out and type on. Tactile feedback is replace with visual feedback - the letters glow more as your finger gets near and they "pop" when you make contact.
- cubefox 3y agoBut what replaces the buttons? You need precise true/false states. Pinching again? That would be just one button. What about aiming/shooting? Just locking and pinching? What about character movement without a stick? This all seems like playing Quake on a touchscreen.
- Simorgh 3y agoYes, that makes sense. A comparison could be drawn from the distinction between the Blackberry keyboard and the iPhone touch surface. Apple’s design approach could well be aiming to make the Vision Pro feel as natural as possible.
- ramesh31 3y ago>I’m not an apple person but I do think the eye tracking to focus / pinch the air to activate combo is very natural and significantly different to what meta, HTC etc are doing. I think this might be the turning point for AR/VR. From getting started in 2015 with the DK2, I've held from the very beginning that controllers are a dead end for VR. I've given countless demos where people are just completely confused because it's so unnatural and awkward, and it adds to the overall cognitive load to the point of destroying presence. Sure competent gamers can figure it out in a few minutes, but that's not the point. You don't interact with the world using triggers and buttons. You interact with the word by interacting with it. The controllers need to go away.
- throwuwu 3y agoReads a bit like when people would complain about having to use a mouse back in the late 80s / early 90s. There’s ton of stuff you’ll never be able to do in VR without some kind of controller with buttons and joy sticks. Making the controllers smaller, lighter, more ergonomic and fairly standardized is the natural path forward. People who grow up with VR and games won’t have a problem.
- zmmmmm 3y agoit's a huge adoption barrier though The problem is the best apps attach all sorts of weird things to weird buttons. I've given plenty of novices a try of a headset and it's a train wreck with them accidentally pushing buttons every which way that completely destroy whatever setup you've done. My favorite is devs like to make the "grip" buttons (on the side where your middle finger rests) shift the frame or scale of world (eg: OpenBrush does this). It's super natural once you know what you are doing, but give that to a novice and it's incredibly hard for them to learn to not grip the controllers. They cling on to them like crazy and the whole world is spinning around and they immediately tell you they are disoriented and nauseated and hate VR.
- jkubicek 3y agoThis could be solved by having well-designed interface guidelines and have those guidelines enforced by the company building the headset. If anyone is going to do that, it's Apple. I'm happy the VisionPro uses gestures to control the interface, but I also agree with the parent poster that we'll need hardware controls someday. No matter how good the gesture recognizers get, waving your hands in space is never going to be as good as having physical controls and buttons attached to your hands.
- jayd16 3y agoHead/eye tracking as user input isn't really new in VR. In the past it has not felt very good. The pinch gesture in the Hololens was very unreliable. Its not natural that your gaze effects the world around you other than making eye contact with someone, perhaps. I think reaching out and gripping things is farm more _natural_. That said, the sensors and software in this headset might finally be up to the task. And despite being unnatural it might be easy enough to pick up.
- dansalvato 3y agoI remember reading a first impressions post where they mentioned that starting off, they were instinctively reaching out and pinching the UI elements. They said it worked fine, because you're also looking at whatever you're pinching, and it only took a few minutes to adjust to keeping their hands in their lap. But I found it promising that the Vision Pro can see your hands in front of you as well, which should really help ease the learning curve, and prevent first-time users from feeling frustration with the UI.
- ShamelessC 3y ago> I think reaching out and gripping things is farm more _natural_. Like when you grab a virtual object and it feels like you're grabbing absolutely nothing at all? This isn't natural and it's actually quite jarring in my experience.
- jayd16 3y agoDefinitely. I think controllers and haptics are really underrated in all this Apple news but I'm still keeping an open mind.
- alkibiades 3y agoso anyone got any good app ideas? wouldn’t mind prototyping something
- graypegg 3y agoSilly little AR models maybe? The thing I’ve trying to cobble together at the moment is a flag waving simulator like https://krikienoid.github.io/flagwaver https://krikienoid.github.io/flagwaver So custom image texture on a model with some animation, so you can checkout how a flag design would look when flying.
- m3kw9 3y agoSome violent little game where it turns all occupants into zombies with real gore
- m3kw9 3y agoTurn your room into 1:1 scale and everything remodeled into over the top designs.
- briandear 3y agoAn app that solves dyslexia.
- mackross 3y agoI would love a bit of AR object recognition with overlays in a target language for language learning. Via the mics you could overlay a translation of whatever was just said as well. A little pinch on an object could tell you what the object is. Another similar idea with object recognition would be an AR scavenger hunt.
- A4ET8a8uTh0 3y agoI was thinking of doing something simple and silly like a model of our solar system with the idea that you can get close ups to everything based on recent high res. images ( ok, maybe that part is not that simple ).
- wlesieutre 3y ago
- tiahura 3y agohttps://developer.apple.com/documentation/visionos/interacting-with-your-app-in-the-visionos-simulator https://developer.apple.com/documentation/visionos/interacti... So, if I setup xcode, I can install the sdk and run the Simulator?
- coffeebeqn 3y agoBut so do I have to buy one with my own money if I want to develop for it ?
- chabes 3y agoYou don’t need an iPhone or iPad to develop iOS apps. A traditional computer should work fine, I would think.
- coffeebeqn 3y agoBut testing it without the actual device would be not ideal
- andsoitis 3y agoThere’s a simulator, like others have said. What do you expect? Apple handing out free devices to developers?
- dylan604 3y agoI remember the company I was at having to shell out $20k for the PSP emulator back when it was a thing. It was a dedicated computer with a tethered cable connecting to a PSP where the optical drive would normally be located. After that experience, I just assumed that was SOP for companies with pre-release units like that.
- cubefox 3y agoFor upcoming videogame consoles, manufacturers do indeed hand out preproduction hardware to developers.
- Gunnerhead 3y agoDo they for indy game developers or just large game studios? Genuinely curious.
- mellosouls 3y agoAlready being discussed: https://news.ycombinator.com/item?id=36423648 https://news.ycombinator.com/item?id=36423648
- cududa 3y agoYeah but that’s all people debating the merits of Vision Pro, not the actual sdk/ documentation released..
- mellosouls 3y agoThe original link is to essentially the same info as this, regardless of the conversational direction.
- KnobbleMcKnees 3y agoOne is a link to a press release and the other to technical documentation. Hardly the same even if the the high level summaries bear some resemblance.
- mellosouls 3y agoOh please, it's the exact same subject.
- imwillofficial 3y agoBut not the same information.
- KnobbleMcKnees 3y agoNo, it isn't? One is mostly a list of examples of apps that have integrated; the other has a table of contents for the developer guide. Have you tried reading past the first couple of paragraphs?
- 3y ago
- Jemm 3y agoApple had the opportunity to make Vision OS more accessible. Instead they chose default gestures that require two hands.
- jeromegv 3y agoThey are typically ahead of the curve when it comes to accessibility feature on iOS. It's very well possible they will have Accessibility options to offer alternatives to those.
- etchalon 3y agoThey discussed those options in the WWDC session. They're fairly extensive, including support voice, head movements, and alternate hand movements.
- d35007 3y agoHere's an article that discusses accessibility features in VisionOS: https://www.macrumors.com/2023/06/07/apple-vision-pro-accessibility-features/ https://www.macrumors.com/2023/06/07/apple-vision-pro-access.... It's a summary of a WWDC session that I haven't watched. One of the items in the article says > Dwell Control will provide on-screen options for Tap, Scroll, Long Press, and Drag, allowing for users to interact with the interface without using their hands. Does the article address any of your concerns?
- dev_tty01 3y agoDefault gestures are irrelevant. Apple always puts a huge effort into accessibility for their platforms. You are condemning the accessibility based on a tiny preview. No need to be concerned. They will have plenty of accessible options for using the device.
- brandonhopkins 3y ago[flagged]
- cududa 3y agoI can’t seem to get the simulator to boot up on my machine. It hung in the “verifying package” part, so I force quit the Xcode Beta, and couldn’t get that screen to pop back up, even after “uninstalling” the beta. Anyone have any ideas?
- saagarjha 3y agoRestart?
- krmblg 3y agoTldr: create a new visionOS app from the menu, it'll prompt to download the support files correctly. Had a similar issue after doing the Xcode 15 beta 2 download with both iOS 17 and visionOS 1 simulator checked. When creating a new visionOS App it would tell me that I'm missing the device/simulator support and prompted to install it. After confirming this it would show a download for a build that ended in xxxxxxxg instead of xxxxxxxf as was part of the download, so I assume that part was updated in the background and now is no longer the correct reference. HTH
- hourago 3y agoThe main problem I see with developing for VisionOS is the lack of reach. I expect that after the initial novelty the user base will be reduced further. The closed development ecosystem of Apple is alluring because it offers access to its iOS devices. But what makes it worth the effort to learn a new SDK, or even buy a MacOs device to develop for it, for just a few thousands of devices?
- pesfandiar 3y agoThe user base may be small but they'll be unusually wealthy.
- robwwilliams 3y agoAt some reputational risk—- Is the Vision Pro actually that expensive at $3500? A high/end LG OLED G3 77 inch TV @ $4,300 A Dell XPS laptop @ $4,000 A 2005 Honda Civic with 225,000 miles @ $3800 NBA season tickets mid-“club” level seats @ $4300 (does not include parking, dinner, transportation) A Barcalounger power reclining loveseat @ $3120 An 11 x 18.5 ft outdoor storage shed made out of plastic and genuine steel frame @ $5274 You might need that Honda if you are barely scrapping by, but if you are like many HN readers then you know damn well that most of what you really needed was taken care of a long time ago. Disposable income is disposable how you see fit. I see fit to buy a Vision Pro after a short test-drive. And I expect to be amazed.
- readyplayernull 3y agoOne word: 2-hours-battery
- andsoitis 3y agoWhy do you think 2 hours battery life for this form factor is a debilitating constraint?
- readyplayernull 3y ago
- hnthrowaway0328 3y agoThe virtual environment reminds me something described by u/patches765 (a user active on reddit regarding DND sessions). Basically he was active in a Startrek MUD decades ago for a while, and one of the administrator asked him to perform a task: take a (virtual) dog and do some scripting, so that he can assess his programming ability. Now that this is definitely not a new idea, but I'd imagine, in the future, if the metaverse does sprang up, maybe we will see the same thing: Hey John Doe here is a widget which is a small window in the metaverse room 211, please write a script and make it interesting, you can do anything. That definitely sounds very interesting. Man since I have a macbook pro at work, I might actually try it out, at least in the simulator.
- bbor 3y agoBy far the most interesting admission from a brief flip-through: Consider how environmental factors impact your app. The characteristics of your physical environment can affect system load and thermals of the device. Consider the effect that ambient room temperature, the presence of other people, and the number and type of real-world objects can have on the your app‘s algorithms. The fact that they’re so prominently focusing on this seems like a soft indication that this device (at least in V1?) is not suited for exercise or sunny outdoor use. Which makes sense, but adds some finality to a “will people use these outside/in public” discussion I was having on here last week
- cubefox 3y agoYeah, and a maximum of two hours battery life indicates the same. In the presentation they also showed indoor usage only.
- solarkraft 3y agothey did show video footage taken with it outside though, didn't they?
- jonathan_oberg 3y agoAnd in the simulator, six different scenarios. All appear to be inside (office, living room, etc.).
- mustacheemperor 3y agoBrings up memories of trying to run the HoloLens 1 on job sites in the northeast during the summer. Standing in the shade, you could get an hour out of it. Step into direct sunlight, power's off in minutes until it can sit in the A/C.
- csk111165 3y agoCan I build or write code in a Windows Machine? I don't have Mac as of now.
- grishka 3y agoYou can try hackintosh. Depending on your hardware, it may work anywhere from great to not at all.
- thyselius 3y agoYeah Xcode on Hackintosh works (at least when I used it a few years ago)
- jkubicek 3y agoDeveloping against a beta API for an unreleased platform is going to be outrageously frustrating on a brand new MacBook, I can't imagine how infuriating it would be trying to do the same on a Hackintosh. If your goal is to hack around and try to get anything at all to work it might be fun, if your goal is to actually build a working VisionOS app, I'd probably suck it up and spend the $1000 on used MacBook.
- grishka 3y agoIf you do want a real Mac but want it cheap, a used Mac Mini would be a better option IMO.
- howinteresting 3y agoApple extracts a massive developer tax in the form of 400% markups on storage and absurd pricing on RAM as well. Sorry.
- ronsor 3y agoThat's not how the Apple ecosystem works
- lcnPylGDnU4H9OF 3y ago> Create custom gestures It's upon reading these words that I realized that every computer I've owned was missing the ability to flip the bird to application windows as a means of force quitting. I'm not ashamed to admit that I'm anticipating that feature.
- graypegg 3y agoI would love to see the internationalization work done for that! Even better, an i18n package for identifying gestures! I’ll flip off Apple Mail, but please let me give Chrome an “up yours”.
- m3kw9 3y agoI’m sure you could set that up in accessibility settings as iOS did
- johnwheeler 3y agoGood way to end zoom calls as well of course
- 111111IIIIIII 3y agoThat's not a new feature, though. It already works cross-platform.
- dutchbrit 3y ago:q!