4 ms·
Apple releases Depth Pro, an AI model that rewrites the rules of 3D vision
- LeoPanthera 2y agoThis presumably is the same model that the Vision Pro Photos app uses to convert 2D photos to 3D.
- sva_ 2y agohttps://news.ycombinator.com/item?id=41738022 https://news.ycombinator.com/item?id=41738022
- fh973 2y agoThis article has a link to the live demo. https://huggingface.co/spaces/akhaliq/depth-pro https://huggingface.co/spaces/akhaliq/depth-pro For some pictures it outputs something reasonable, for others it's completely broken (black with colored noise in one area).
- ipsum2 2y agoTitle is such clickbait, it does not rewrite the rules of 3d vision, it is a marginal improvement on existing models, and does not work for video, only images. However, Apple open sourced the model weights, which is amazing for research.
- Tepix 2y agoRight, the title is so awful that i didn't even feel like reading the article.
- esperent 2y agoI made it about a third of the way down. It doesn't get any better. Gave up when I hit the auto playing unrelated video that you can't scroll past. Do people really keep reading an article while a video about something else is playing on the top third of their screen? Totally nuts.
- bsenftner 2y agoIt's AI generated PR, perhaps the worst use of AI.
- fxtentacle 2y agoIntel open sourced Midas, too, which seems to have pretty similar result quality.
- bamboozled 2y ago“The greatest model, just got better, introducing…” can I have a job now ?
- amelius 2y agoWhat is the topology of the model like?
- dyauspitr 2y agoCan I use this to generate accurate depth maps from 2-D images that I can then CNC or 3-D print?
- j5155 2y agoNo. You’ll want a photogrammetry or LIDAR app for that.
- stavros 2y agoMaybe, if you're OK with printing just the front face of an object with its depth being roughly estimated.
- pavlov 2y agoYou can of course do some great art with just a depth map manifested in a substance like marble: https://en.wikipedia.org/wiki/Parthenon_Frieze https://en.wikipedia.org/wiki/Parthenon_Frieze (Exaggerating a bit. Ancient Greek reliefs do have sculpted detail on the underside, e.g. the horse legs come slightly detached from the surface. So they are not 100% depth maps.)
- KaiserPro 2y agoKinda, but you dont get the back.
- zimpenfish 2y agoJust tried it on a "difficult" image (relatively low contrast photo of a small thin plant in front of a tree trunk with a distant fence in one corner) and it did a pretty good job, I think - https://imgur.com/a/Sqr6hR8 https://imgur.com/a/Sqr6hR8 including the depth maps.
- zimpenfish 2y agoMind you, it failed completely on my next test image - https://imgur.com/a/nFYtl77 https://imgur.com/a/nFYtl77
- deleted 2y ago[deleted]
- kylehotchkiss 2y agoWas this trained on iPhone photos since there is a decent amount of depth references within iPhone cameras? It’s interesting to see how clearly it understands depth of field. With that, how does it perform on F16 and above?
- skykooler 2y agointeresting. They claim 0.3 seconds on a consumer GPU; I thought that might scale to 30 seconds or so on CPU but gave up waiting after twelve minutes.
- knolan 2y agohttps://huggingface.co/spaces/akhaliq/depth-pro https://huggingface.co/spaces/akhaliq/depth-pro
- deleted 2y ago[deleted]