16 ms·

Meta introduces Segment Anything Model 2

274 points by bambax 2y ago

gnabgib 2y ago
Discussion (720 points, 1 day ago, 130 comments) https://news.ycombinator.com/item?id=41104523 https://news.ycombinator.com/item?id=41104523
- cubefox 2y ago
  Surprising how quickly big news disappear from the front page. Hacker News seems to be optimized for people who check the website multiple times per day.
  - pjmlp 2y ago
    Gotta to do something between CI/CD deployments. :)
  - buran77 2y ago
    I'm also periodically surprised that topics that seem to be of core interest and very popular on HN just drop off the front page in a matter of hours. Meanwhile discussions like this one [0] (which stayed on the front page with not even 20 upvotes and 4-5 comments for almost 20h before some discussion picked up) seem to artificially stay on the front page for a day or more. It's probably less algorithmic and more arbitrary. [0] https://news.ycombinator.com/item?id=41067079 https://news.ycombinator.com/item?id=41067079
  - tgv 2y ago
    Try something like https://news.ycombinator.com/?over=100 https://news.ycombinator.com/?over=100. It decays less quickly (at the expense of lesser scoring, recent posts).
    - mattmanser 2y ago
      Looking at that list HN has really shifted from a tech entrepreneur website to a programmer, especially linux, centric site. That is nothing like the list I would have seen 15 years ago when I first joined in 2009. Then again I don't miss the "101 ways to not need sleep and work all night on your startup" posts. Really seems to have shifted away from anything entrepreneurship or running your own business, the mantle it took over from Joel's "Business of Software" forum. Wonder where that discussion's all gone. Plus I just got a reminder how rubbish Google is right now and how vulnerable they are to having their lunch eaten. I couldn't remember what Joel Spolsky's foum was called, and it kept returning absolute crap for various search terms that would have instantly worked 5 years ago. God, I sound like a grumpy old man, but the internet has turned shite. Or at least how I consume it has.
  - liamYC 2y ago
    I built an email notifier for alerting me when there is a popular news article which I defined by X number of comments. I think forums like hacker news are a really cool indicator for an emerging technology, an opportunity, or some exciting tech story. I get a tonne of false positives though, mostly articles that are inflammatory get sent to me. However, crowd strike triggered it as did the release of chat gpt so there are some hits
  - temp_account_32 2y ago
    the algorithm that fudges the order of the front page can be so annoying sometimes, i accidentally refresh the page, and a link that was top 10 on the front page a few minutes ago is now buried in page 3 suddenly
    - yjftsjthsd-h 2y ago
      That's not the reason I use https://hckrnews.com/ https://hckrnews.com/ , but it's another good reason.
  - greenchair 2y ago
    It probably has more to do with employees working at the company downvoting the thread.
  - klarxa 2y ago
    [flagged]
d3m0t3p 2y ago
it says that the released the code, but I couldn't find any except some example code, Did they release the training code ?
- Sayrus 2y ago
  I think that repository is what they are talking when they say "releasing a pretrained Segment Anything 2 model, [...] and code": https://github.com/facebookresearch/segment-anything-2 https://github.com/facebookresearch/segment-anything-2
  - moffkalast 2y ago
    Now we just need sam2.cpp ;)
null_investor 2y ago
Meta is killing it. Google seems to be lagging behind them in AI research and useful things that is shared within the community. I'm sure this, LLAMA and the other projects that they have will help drive up new creations, companies and progress. I'm also sure that this kind of openly sharing code and research will drive up business value for them. It may be hard to say right now what it is, but I'm sure it will. That's the difference of a founder-led company vs. market led. Google is mostly concerned on short-term goals so they don't report a single bad quarter or has too high CAPEX on a project without profit on its sight (like VR). Once Meta finds the killer app for VR, all the other companies will be so many years behind that they will need to buy software from Meta or not take any market share in this new space. Similar to what happened about AI chips and Nvidia. Nobody was investing enough on it.
- sverhagen 2y ago
  I know nothing here, but isn't that also the difference: Meta is just trying out things, and can find that killer application later. Google meanwhile existentially feels that search must be the killer application, and tries to shoehorn everything into that. And in doing so put the bar for success so, so high, ignoring where things are really at.
  - SXX 2y ago
    Problem is that Google core product is not search, but ads. Over years they were slowly degrading search experience because making search better, faster and more efficient means we would spend less time watching ads. Situation is the same on YouTube where Google have insane market monopoly, but still depreoritize actual creators who made their platform successful to appeal to brands and push more and more ads. Demonetization of everything ever slightly controversial. Somehow Google index whole internet 100 times a day, their OS run on majority of smartphones, their browser is monopoly, they know everything about everyone, but can't even filter spam efficiently. I never liked or used Facebook / Instagram much, but at least Meta core products are not deteriorating at same insane pace Google products are. I can still use WhatsApp daily without ads being fed down my throat.
SXX 2y ago
If someone would tell me just a decade ago that Facebook will become one of the most open innovating companies and Mark Zuckerberg one of sane billionares I would really laugh in their face. But now... Regardless of how actually successful their attempts at VR and AI end up they already going to have some place in history for that.
- sverhagen 2y ago
  Grading on a curve...
- cube2222 2y ago
  To be fair, they have a very long history of open-sourcing internal software, and it becoming industry standards, this is not at all new, as some have been saying. Especially so in database technology: rocksdb, zstd compression, presto, Cassandra, Hive, Velox (this one’s new) are all Meta’s doing. And those are just the popular ones, there’s way more (database-related) projects they open sourced that didn’t get too popular! So all in all, as much as I’m happy to complain about them as a company, they’ve always been huge contributors to the open-source ecosystem.
  - SXX 2y ago
    While this is true they wasn't so different before compared to Google and even Microsoft in later years. Other companies also released a lot of open source software. AI research is different though. Everyone else decided against open source and started to dig their own moats justifying it with different kind of BS. Yet Facebook / Meta has decided to be on side of open innovations.
  - iddan 2y ago
    Also in web development technologies: React, React Native, Jest, GraphQL, & Docusaurus
- space_oddity 2y ago
  I love my Oculus but VR has yet to achieve the cultural ubiquity (mb off topic).
jonatron 2y ago
Thanks the thousands of African workers doing the boring repetitive dataset work.
- anentropic 2y ago
  the real heroes
lakfha 2y ago
So you can track "objects" like people in a shopping mall and they are releasing it as a commoditized complement. What are possible scenarios? 1) Advertisers build tracking systems in supermarkets and malls and Facebook sells them the profiles of the victims. 2) Facebook is getting people hooked on the "free" models but will later release a better and fully closed model with tracking software so advertisers have to purchase both profiles and the software. 3) Facebook releases the model in order to create goodwill among (a subset of) the developer population and normalize tracking. The subset of developers will also act as useful idiots in the EU and promote tracking and corporate power.
- artificialprint 2y ago
  Tracking objects is a different task from segmentation, whatever you are describing doesn't need what Facebook released today. In AI a lot of things are overlapping and some stuff that they have been releasing has no direct use for them. Segmentation is helpful in creative applications, think of video editors that can segment the objects in the video and replace the background etc. Green screen type of thing.
  - IshKebab 2y ago
    It's a closely related task. This seems capable of at least some tracking.
- SXX 2y ago
  Wouldn't it be easier to achieve these nefarious goals if it's was a closed model that only few actors know about and have access to? Do you think such models not yet exist or deployed? If you want to look for something behind what Facebook doing now then it's pretty clear they damaging a moat of their competitors like Google and Microsoft (AI.com). Meta competitors dump shitloads of money on GPUs and running their cloud AIs. When Meta releasing open models in wild where everyone and their cat can run them it's only make this arm race more expensive for proprietary AI offerings.
- thinkingemote 2y ago
  It's (still) for the metaverse even when people say it has flopped, this is directly for that aim. Tracking of everything via live camera vision
npiano 2y ago
I always think of the holographic orbit mapping UI from The Expanse when I see something like this. It's the paper of the future that will be hooked into everything we think about. Such a powerful tool for exploring the world.
asah 2y ago
Impressive results! Here's a test video from inside Mercer Labs: https://youtu.be/W7kM0ISXkpQ?feature=shared https://youtu.be/W7kM0ISXkpQ?feature=shared
- afro88 2y ago
  What am I looking at, and how is it related to SAM2?
switchstance 2y ago
I would have killed for this back in my editing and motion graphics days. The Roto Brush in After Effects is similar, but its quality has always been lacking and it takes forever to process.
- space_oddity 2y ago
  Roto Brush in After Effects is a lifesavers but with limitations. SAM is definitely a game-changer!
deleted 2y ago
[deleted]
jdhzzz 2y ago
No love for Firefox.

274 points by bambax 2y ago

Discussion (720 points, 1 day ago, 130 comments) https://news.ycombinator.com/item?id=41104523 https://news.ycombinator.com/item?id=41104523

cubefox 2y ago
Surprising how quickly big news disappear from the front page. Hacker News seems to be optimized for people who check the website multiple times per day.
- pjmlp 2y ago
  Gotta to do something between CI/CD deployments. :)
- buran77 2y ago
  I'm also periodically surprised that topics that seem to be of core interest and very popular on HN just drop off the front page in a matter of hours. Meanwhile discussions like this one [0] (which stayed on the front page with not even 20 upvotes and 4-5 comments for almost 20h before some discussion picked up) seem to artificially stay on the front page for a day or more. It's probably less algorithmic and more arbitrary. [0] https://news.ycombinator.com/item?id=41067079 https://news.ycombinator.com/item?id=41067079
- tgv 2y ago
  Try something like https://news.ycombinator.com/?over=100 https://news.ycombinator.com/?over=100. It decays less quickly (at the expense of lesser scoring, recent posts).
  - mattmanser 2y ago
    Looking at that list HN has really shifted from a tech entrepreneur website to a programmer, especially linux, centric site. That is nothing like the list I would have seen 15 years ago when I first joined in 2009. Then again I don't miss the "101 ways to not need sleep and work all night on your startup" posts. Really seems to have shifted away from anything entrepreneurship or running your own business, the mantle it took over from Joel's "Business of Software" forum. Wonder where that discussion's all gone. Plus I just got a reminder how rubbish Google is right now and how vulnerable they are to having their lunch eaten. I couldn't remember what Joel Spolsky's foum was called, and it kept returning absolute crap for various search terms that would have instantly worked 5 years ago. God, I sound like a grumpy old man, but the internet has turned shite. Or at least how I consume it has.
- liamYC 2y ago
  I built an email notifier for alerting me when there is a popular news article which I defined by X number of comments. I think forums like hacker news are a really cool indicator for an emerging technology, an opportunity, or some exciting tech story. I get a tonne of false positives though, mostly articles that are inflammatory get sent to me. However, crowd strike triggered it as did the release of chat gpt so there are some hits
- temp_account_32 2y ago
  the algorithm that fudges the order of the front page can be so annoying sometimes, i accidentally refresh the page, and a link that was top 10 on the front page a few minutes ago is now buried in page 3 suddenly
  - yjftsjthsd-h 2y ago
    That's not the reason I use https://hckrnews.com/ https://hckrnews.com/ , but it's another good reason.
- greenchair 2y ago
  It probably has more to do with employees working at the company downvoting the thread.
- klarxa 2y ago
  [flagged]

d3m0t3p 2y ago

it says that the released the code, but I couldn't find any except some example code, Did they release the training code ?

Sayrus 2y ago
I think that repository is what they are talking when they say "releasing a pretrained Segment Anything 2 model, [...] and code": https://github.com/facebookresearch/segment-anything-2 https://github.com/facebookresearch/segment-anything-2
- moffkalast 2y ago
  Now we just need sam2.cpp ;)

null_investor 2y ago

Meta is killing it. Google seems to be lagging behind them in AI research and useful things that is shared within the community. I'm sure this, LLAMA and the other projects that they have will help drive up new creations, companies and progress. I'm also sure that this kind of openly sharing code and research will drive up business value for them. It may be hard to say right now what it is, but I'm sure it will. That's the difference of a founder-led company vs. market led. Google is mostly concerned on short-term goals so they don't report a single bad quarter or has too high CAPEX on a project without profit on its sight (like VR). Once Meta finds the killer app for VR, all the other companies will be so many years behind that they will need to buy software from Meta or not take any market share in this new space. Similar to what happened about AI chips and Nvidia. Nobody was investing enough on it.

sverhagen 2y ago
I know nothing here, but isn't that also the difference: Meta is just trying out things, and can find that killer application later. Google meanwhile existentially feels that search must be the killer application, and tries to shoehorn everything into that. And in doing so put the bar for success so, so high, ignoring where things are really at.
- SXX 2y ago
  Problem is that Google core product is not search, but ads. Over years they were slowly degrading search experience because making search better, faster and more efficient means we would spend less time watching ads. Situation is the same on YouTube where Google have insane market monopoly, but still depreoritize actual creators who made their platform successful to appeal to brands and push more and more ads. Demonetization of everything ever slightly controversial. Somehow Google index whole internet 100 times a day, their OS run on majority of smartphones, their browser is monopoly, they know everything about everyone, but can't even filter spam efficiently. I never liked or used Facebook / Instagram much, but at least Meta core products are not deteriorating at same insane pace Google products are. I can still use WhatsApp daily without ads being fed down my throat.

SXX 2y ago

If someone would tell me just a decade ago that Facebook will become one of the most open innovating companies and Mark Zuckerberg one of sane billionares I would really laugh in their face. But now... Regardless of how actually successful their attempts at VR and AI end up they already going to have some place in history for that.

sverhagen 2y ago
Grading on a curve...
cube2222 2y ago
To be fair, they have a very long history of open-sourcing internal software, and it becoming industry standards, this is not at all new, as some have been saying. Especially so in database technology: rocksdb, zstd compression, presto, Cassandra, Hive, Velox (this one’s new) are all Meta’s doing. And those are just the popular ones, there’s way more (database-related) projects they open sourced that didn’t get too popular! So all in all, as much as I’m happy to complain about them as a company, they’ve always been huge contributors to the open-source ecosystem.
- SXX 2y ago
  While this is true they wasn't so different before compared to Google and even Microsoft in later years. Other companies also released a lot of open source software. AI research is different though. Everyone else decided against open source and started to dig their own moats justifying it with different kind of BS. Yet Facebook / Meta has decided to be on side of open innovations.
- iddan 2y ago
  Also in web development technologies: React, React Native, Jest, GraphQL, & Docusaurus
space_oddity 2y ago
I love my Oculus but VR has yet to achieve the cultural ubiquity (mb off topic).

jonatron 2y ago

Thanks the thousands of African workers doing the boring repetitive dataset work.

anentropic 2y ago
the real heroes

lakfha 2y ago

So you can track "objects" like people in a shopping mall and they are releasing it as a commoditized complement. What are possible scenarios? 1) Advertisers build tracking systems in supermarkets and malls and Facebook sells them the profiles of the victims. 2) Facebook is getting people hooked on the "free" models but will later release a better and fully closed model with tracking software so advertisers have to purchase both profiles and the software. 3) Facebook releases the model in order to create goodwill among (a subset of) the developer population and normalize tracking. The subset of developers will also act as useful idiots in the EU and promote tracking and corporate power.

artificialprint 2y ago
Tracking objects is a different task from segmentation, whatever you are describing doesn't need what Facebook released today. In AI a lot of things are overlapping and some stuff that they have been releasing has no direct use for them. Segmentation is helpful in creative applications, think of video editors that can segment the objects in the video and replace the background etc. Green screen type of thing.
- IshKebab 2y ago
  It's a closely related task. This seems capable of at least some tracking.
SXX 2y ago
Wouldn't it be easier to achieve these nefarious goals if it's was a closed model that only few actors know about and have access to? Do you think such models not yet exist or deployed? If you want to look for something behind what Facebook doing now then it's pretty clear they damaging a moat of their competitors like Google and Microsoft (AI.com). Meta competitors dump shitloads of money on GPUs and running their cloud AIs. When Meta releasing open models in wild where everyone and their cat can run them it's only make this arm race more expensive for proprietary AI offerings.
thinkingemote 2y ago
It's (still) for the metaverse even when people say it has flopped, this is directly for that aim. Tracking of everything via live camera vision

npiano 2y ago

I always think of the holographic orbit mapping UI from The Expanse when I see something like this. It's the paper of the future that will be hooked into everything we think about. Such a powerful tool for exploring the world.

asah 2y ago

Impressive results! Here's a test video from inside Mercer Labs: https://youtu.be/W7kM0ISXkpQ?feature=shared https://youtu.be/W7kM0ISXkpQ?feature=shared

afro88 2y ago
What am I looking at, and how is it related to SAM2?

switchstance 2y ago

I would have killed for this back in my editing and motion graphics days. The Roto Brush in After Effects is similar, but its quality has always been lacking and it takes forever to process.

space_oddity 2y ago
Roto Brush in After Effects is a lifesavers but with limitations. SAM is definitely a game-changer!

deleted 2y ago

[deleted]

jdhzzz 2y ago

No love for Firefox.