7 ms·
Meta Releases New AI-Based Photo Segmentation Tool to Everybody
- bioemerl 4y agoUnrelated, but can we please get web browsers to enable users to totally turn off all auto play video and video encoding? I hate websites like this where you deal with a minefield of video areas that might start playing audio at the smallest tap and drain your bandwidth for content you have zero desire to watch.
- go_elmo 4y agoIm autistic and have the same Problem. I use chrome extensions which work fine
- wbobeirne 4y agoMany browsers have settings built in for this, and those that don't natively definitely have browser extensions for doing this.
- bioemerl 4y agoI'm not sure chrome mobile has either. Yep, Google removed the setting to disable it in version 80 for Android.
- kaladin_1 4y agoI guess my ad blocker or some configuration protected me from it. I didn't encounter a single auto-play video or audio.
- dmm 4y agoFirefox can block audio/video autoplay. You can set a default and have per-site exemptions: https://support.mozilla.org/en-US/kb/block-autoplay https://support.mozilla.org/en-US/kb/block-autoplay
- KaiserPro 4y agoMy firefox seems to not play it by default.
- chankstein38 4y agoOr news sites that play some annoying caster talking about it while you're trying to read and it follows you down the page. I'm here for an article not someone reading it to me.
- m3kw9 4y agoGeez what would I do without another photo segmentation program?
- shapefrog 4y agoMight retire the 20 year old bash script I use with its advanced Ai if pixelA != pixelB loop.
- jmiskovic 4y agoHere's a great summary: https://twitter.com/DrJimFan/status/1643647849824161792 https://twitter.com/DrJimFan/status/1643647849824161792
- deleted 4y ago[deleted]
- mistrial9 4y agothese are toy examples
- version_five 4y agoIf course they are. I haven't looked into this model in particular, but unless I'm way off base, these general purpose pretrained things are completely unsuitable for any specialized (say medical or whatever) application. This seems just like a better version of some of the previous semantic segmentation models they trained on coco. It's probably a good starting point for fine tuning for custom application though, that's the main use of these big models.
- sillysaurusx 4y agoMeta does stellar work in AI. I’m quite certain the recent DMCAs were a case of the left hand not knowing what the right hand is doing. This model is open source in every sense of the word, and they’ve now released two impactful models in the span of a month. This tweet chain is a pretty great overview: https://twitter.com/drjimfan/status/1643647849824161792?s=61&t=jQbmCk1JqL7depzFWJNuPA https://twitter.com/drjimfan/status/1643647849824161792?s=61...
- kamranjon 4y agoAre the weights open source?
- Name_Chawps 4y agoThe weights are not "source".
- sokoloff 4y agoThat is likely true in the most pedantic sense, but in practice, if I create an algorithm that works by using a series of matrix transformations against a set of carefully chosen (read: "trained") matrices and I open-source only the matrix manipulation code but not the specially chosen matrices, I think there's a fair argument to say that I haven't open-sourced the entire algorithm. In the phrase "the model is open-source in every sense of the word", that, IMO, must include the weights.
- Name_Chawps 4y agoI'd be curious to know if you think open source companies should share all of their database records too.
- sokoloff 4y agoI think of two broad categories of database records: transactional data (data created while running the system) and domain data (data created during development and shipped to production as part of the release process). The former type of data I wouldn't expect to ever be open-sourced. The latter type might or might not be, depending on the intent of open-sourcing the related system. If I created a human language translation system that used a SQL database to store the dictionary (domain) data and claimed the system was open-source without shipping the domain data, I think people would rightly say that the system was not fully opened.
- whalesalad 4y agoI've been wanting to build an app that will transform a photo into a template for stained glass. Interactive, to choose the "granule" size, merge color groups into one single piece, change border thickness, etc. Something like this would really help there and make it almost a piece of cake.
- chankstein38 4y agoYeah it basically does the first part that with a few lines of code! I've been playing with it using it to segment images and just randomly shake each segment in a short gif. Just to kind of mess around with it until I've found a real use for it or more time to implement some of the more interesting use cases I've got. I'm super pumped this was released!
- eterps 4y agoAre there any open source alternatives for this? Or still too early?
- whalesalad 4y agogive it 36 hours and we'll have segMenPoTader.cpp
- woopwoop 4y agoThe model is open source https://github.com/facebookresearch/segment-anything/ https://github.com/facebookresearch/segment-anything/
- xienze 4y agoSAM itself _is_ open source: https://github.com/facebookresearch/segment-anything https://github.com/facebookresearch/segment-anything ASL 2 license.
- jookuma 4y agoI wrote a napari-plugin for it, https://github.com/JoOkuma/napari-segment-anything https://github.com/JoOkuma/napari-segment-anything You just need to have napari installed. I only tested on Linux, so it might not work on Windows/OSX.
- dragonwriter 4y agoThis is the open source alternative.
- graderjs 4y agoI relly hope Meta (FB research) releases this wonderful noise reduction library: https://github.com/facebookresearch/denoiser https://github.com/facebookresearch/denoiser I tested MANY while building various audio tech and this was by far the best (beats the shit out of all the python Pandas Hugging Face lists etc). Incredibly ability to cut noise (tho, it must be noted that perceptual improvements for humans do not usually increase machine transcription as AI models strangely seem to pull info out of the dead space between words, and the noise around words...not just the voiced words themselves...the hidden vibrations, beyond our human ken, oh mere mortals unworthy of the grand perceptive machines...ugh...:p :o ;p xx ;p) I contacted the authors via their FB emails but never heard back. Right now it's non-commercial and I was building a commercial product.
- causi 4y agoHow does it compare to Adobe's recent AI audio enhancement?
- graderjs 4y agoNot sure. Anyone else wanna chime in on that? BTW - in my search just now in response to your question, I see Dolby also has an API: https://dolby.io/products/enhance/ https://dolby.io/products/enhance/
- causi 4y agoInteresting that all of these seem to work extremely well but none are actually available to end users as an unrestricted product.
- bick_nyers 4y agoSomewhat tangential question, have you looked for/found any audio models/tools that can be used for separating out individual voices to separate audio tracks automatically? Perhaps this is already possible with existing tools that I am uninitiated in.
- 4y ago
- wongarsu 4y agoDiscussion from yesterday: https://news.ycombinator.com/item?id=35455566 https://news.ycombinator.com/item?id=35455566
- Brajeshwar 4y agoI'm extremely sorry but I might have submitted a mismatch title and URL. I stumbled on about 5-6 outlets via Twitter. Here is the announcement from Meta (erstwhile Facebook) https://ai.facebook.com/blog/segment-anything-foundation-model-image-segmentation/ https://ai.facebook.com/blog/segment-anything-foundation-mod...
- crazygringo 4y agoAny idea how/when this will make it into Photoshop? According to the article, the weights haven't been open sourced, so nobody can take this and build their own Photoshop plugin. But I'm incredibly curious if they'll license this to Adobe, or if Adobe's already got its own team building the same thing that'll be just as good, or what. It's not super-clear to me why Meta as opposed to Adobe has come out with this first, except maybe to be able to apply filters to just segments of photos in Insta?
- polygamous_bat 4y ago> According to the article, the weights haven't been open sourced, so nobody can take this and build their own Photoshop plugin. The article seems to be misleading, since I can just go to the github and download the weights right now: https://github.com/facebookresearch/segment-anything#model-checkpoints https://github.com/facebookresearch/segment-anything#model-c... However, for sake of fairness, competition, and reproducible science, I hope that if Adobe makes this a part of their commercial offering, they train their own so we can have two variants of the same model available to us.
- gardaani 4y agoPhotoshop already has the Object Selection tool: https://helpx.adobe.com/photoshop/using/tool-techniques/object-selection-tool.html https://helpx.adobe.com/photoshop/using/tool-techniques/obje... I tried Meta's photo segmentation tool and I didn't see anything magical in it.
- llovan 4y agoI haven't tried Meta's yet but Photoshop's tool though decent struggles with complex scenes
- nmstoker 4y agoPerhaps it's not as sophisticated as Meta, but doesn't iOS16 do this? I recall my partner discovering it by accident whilst messing about with some photos. The people in the foreground were lifted off the background.
- ardit33 4y agoYes, but it is closed to Apple's app only. Android has something something similar, but they haven't released to the public. Meta is releasing it to everyone, so you can use it on your own apps/services. (and it is a great implementation/state of the art).
- nmstoker 4y agoThanks for confirming (wasn't sure if I'd misremembered it somehow!!) And totally with you that the Meta release is great for getting this kind of thing more widely adopted.
- figomore 4y agoIt’s similar but the iOS just segment the main object in an image.
- mbesto 4y agoVery meta (pun intended) but is there a website that allows you to say "I want to find an AI engine / application that does X", where X might be any iteration of terms: "magic wand tool that cuts an image from the background" "like photoshop where you cut an object from the background" "photo segmentation tool" Google would be the de facto here, but its kind of worthless as its gamed by SEO.