16 ms·
Show HN: I built an interactive cloth solver for Apple Vision Pro
A bit more context - the cloth sim is part of my app, Lungy (https://www.lungy.app https://www.lungy.app). It's designed to be an active meditation / relaxation app, so you can play relaxing instruments in space and immersive breathing exercises. The original Lungy is a breathing app available for iOS, that uses real-time breathing with interactive visuals.
The cloth sim is a Verlet integration, running on a regular grid. For now, I have tried a couple of different cloth scenes - a sort of touch reactive 'pad', where different parts of the cloth are mapped to different sounds and a cloth that blows in sync with breathing. The collision detection is a little bit tricky with the deforming mesh, but seems to work ok overall. Overall, it seems like a cool interaction to explore.
The cloth sim is live on the app store now (and free) - would love to hear feedback from anyone with a Vision Pro.
App Store (Vision Pro): https://apps.apple.com/app/id6470201263 https://apps.apple.com/app/id6470201263
Lungy, original for iOS - https://apps.apple.com/app/id1545223887 https://apps.apple.com/app/id1545223887
- gizajob 2y agoWhatever happened to the Vision Pro? It seems quite strange for Apple to have flubbed its release so hard and to have also gotten away with it.
- deleted 2y ago[deleted]
- jazzyjackson 2y agobunch of people tried it and returned it, apple didn't really say anything and kept shipping OS updates developers are developing but it's a small clique i don't think it's regarded as a commercial flop because there's bound to be a gen 2, hopefully by then there are some apps in the app store but i agree with your characterization that they got away with a flubbed release
- deleted 2y ago[deleted]
- jncfhnb 2y agoIt seems weird that the interface seems to encourage interacting with it from afar and has no indicators as to where your actions would affect it (like a highly on a pickupable node). Is there some sort of intuitive reason for that that’s not obvious on a video? Not a complaint just curious.
- lukko 2y agoGood point - I should have probably shown the direct interaction too (touching the actual fabric in space) - there's a gif here: https://jmp.sh/s/lHqJm6NEvqMqkXMPyUpZ https://jmp.sh/s/lHqJm6NEvqMqkXMPyUpZ. It was a little but laggy when also screen recording on device. In the video I am looking at where I want to interact and then using a pinch gesture and the sounds are mapped to different cells of the cloth. By either looking and tapping, or playing directly you can hopefully play your intended sound.
- jncfhnb 2y agoSo it looks for gesture events and maps them to locations where your eyes are looking rather than where the gesture was done? Is that how most vision pro interfaces work?
- lukko 2y agoYes, that's basically it. If the gesture is targeted to something, either by looking at it or touching it directly in space then it responds. Direct touching takes priority, so I think you could look away but still touch in space.
- kromokromo 2y agoFrom the title I thought you made a optical recognition system for sorting out the laundry, finding sock pairs etc. Very cool sim, but kind of disappointed still. Will build this someday.
- lukko 2y agoHaha, I wish - that would be great!
- macintux 2y agoI half-joked on (then) Twitter about 15 years ago that if someone made AR that would help me sort my clothes by laundry temperature I’d buy it in a heartbeat. Then a friend told me I could just wash everything in cold water. Crisis averted.
- deleted 2y ago[deleted]
- throwaway115 2y agoCongrats! What has it been like developing on the AVP?
- lukko 2y agoThanks! It's been fun. It's not too dissimilar to iOS - a lot of spatial capabilities are linked very closely with RealityKit, it's worth looking at the API if you're interested. I was thinking we'd use Metal for rendering, but as I think there are privacy issues with accessing the raw camera data, it's only supported for 'full' spaces, so not the mixed / camera feed + overlay.
- goeiedaggoeie 2y agoAPI's are a lot more limited than IOS however from my experience.
- xyst 2y agoIs the choppy movement of the cloth because of the limitations of the device or something else? Can’t believe this is what $4-5K piece of tech looks like. Wild.
- wouldbecouldbe 2y agoI’ve been trying to figure out if Vision Pro suffers the same fate as other AR glasses that it can’t be used in the sun, Anyone knows?
- wtallis 2y agoIt's not AR glasses. It's VR with lots of cameras.
- samatman 2y agoYou're describing an approach to implementing AR. Simple test: can you get a drink out of the fridge while wearing the headset? If the answer is yes, it's AR.
- wtallis 2y agoThe definitions of these terms are certainly not fixed or universally agreed-upon, but on the spectrum from VR to MR to AR, the Vision Pro is definitely not at the AR end of things, and is very much not the class of device that the term "AR glasses" refers to. The problems that "AR glasses" have with operating outside in full daylight are inherent to a class of devices that does not include the Vision Pro. To the extent that the Vision Pro works better outdoors than whatever "AR glasses" OP had in mind, it's because the Vision Pro is a fundamentally different kind of device with wildly different tradeoffs and design goals.
- samatman 2y agoSo to summarize: unlike other AR glasses, it isn't unusable in sunlight, because it uses cameras to provide augmented reality, rather than something else. Got it.
- crazygringo 2y agoWhy "other" AR glasses? AVP is not glasses. It's a headset. Headsets and glasses are two entirely different product categories.
- pavlov 2y agoI literally haven’t thought about the Vision Pro even a single time in months. Wild for such a hyped-up technology product. It just shipped and vanished.
- sneak 2y agoI use mine almost every day, it's awesome for traveling. It might be the best "watching videos in bed" device ever made.
- consumer451 2y agoThis frightens me. I have been working at reducing my time of watching videos in bed, and all I have to tempt me is a phone and a laptop. It's such an easy trap to fall into. Spending time horizontal while not asleep is very unhealthy for your heart, and many other systems in your body.
- TheNorthman 2y ago> Spending time horizontal while not asleep is very unhealthy for your heart. Why is this?
- consumer451 2y agoTo be clear, it's not that sleeping while horizontal is better than being awake while horizontal. We all need solid sleep, but being horizontal should otherwise be minimized as it is the ultimate sedentary lifestyle.[0] This causes heart atrophy. [0] https://www.betterhealth.vic.gov.au/health/healthyliving/the-dangers-of-sitting https://www.betterhealth.vic.gov.au/health/healthyliving/the... see my other comment for other references: https://news.ycombinator.com/item?id=40549893 https://news.ycombinator.com/item?id=40549893
- SkyPuncher 2y agoI think you’re incorrectly jumping to correlations/causations. Your references are due to sedentary, not laying down. You can have a sedentary life standing in place most of the day. Likewise, the problem is being sedentary, not what position your sedentary in.
- hi-v-rocknroll 2y agoWilling to trade a barely-used Quest Pro for an AVP. ;@D
- phyalow 2y agoIm willing to trade a barely used AVP for ££
- superamit 2y agoThis is really cool! I save AVP for work but have been eager to find new meditation interfaces because it feels like AR has so much potential for this. Will try it out!
- localfirst 2y agoguys im interested in developing for Apple Vision Pro, what are some gotchas, are you seeing success, what have you put on the store?
- gizajob 2y agoMain gotcha: nobody owns one.
- spaceman_2020 2y agoNot to disparage OP or this product - which sure looks cool - but man, the idea of buying a $3500 device to simulate something I can do by opening my wardrobe seems…absurd.
- dorkwood 2y agoDid you watch the video? I don't think anyone has anti-gravity cloth that lights up on touch in their wardrobe.
- elliottkember 2y agoYou’ll be delighted to know that the $3500 device can actually run many other applications!
- hehdhdjehehegwv 2y agoCan it though? What apps are people actually using? Apple is very much not having an iPhone moment with Vision Pro: there is no explosion of creativity or a new market rush. And there may never be one. Apple treated devs like trash for years and now they have a new platform nobody wants to build on. Oops.
- actionfromafar 2y agoI imagined it would be a tool for designing clothes. It would then output cutting patterns or stitching instructions. That would be the solving part. :)
- Falimonda 2y agoAre you able to have it interact with the environment? Say you slide it over so it's hovering over the edge of your sofa and then you turn gravity on. It seems like you're just a few steps away from what!
- v1sea 2y agoReally neat, are you running the cloth simulation on the CPU or GPU? How many elements are in the simulated cloth? Good luck on future AR projects!
- lukko 2y agoThe cloth sim is GPU. It’s not that heavy currently, around 40k quads. You could go much heavier, easily 500k, but it also changed the cloth behaviour. The limiting factor is actually not the sim, but the initial load time for the procedural geometry. I might try adding some subdivisions though..
- mritchie712 2y agohow do you track breathing for Lungy? Is it using the microphone?
- lukko 2y agoI've just made a ShowHN for Lungy here, it has some more details: https://news.ycombinator.com/item?id=40553986 https://news.ycombinator.com/item?id=40553986