3 ms·
Thing is when you segment everything in a scene, sometimes those things are actually just one object say a laptop, and it starts segmenting trackpad, individual
by m3kw9 4y ago
Thing is when you segment everything in a scene, sometimes those things are actually just one object say a laptop, and it starts segmenting trackpad, individual keys, screen. And then you need another algorithm or human intervention to say this segment is pointless etc, a noise filter
- alsodumb 4y agoWhich is not bad imo. Infact SAM actively proposed a fix for this. Bounding box algorithms are relatively easier to train and SAM can take in a rough bounding box of the laptop as input prompt and create a detailed segmentation of laptop. Their webpage has an example with a bunch of cats. SAM is good at (i) deciding detailed mask around segments, (ii) taking a wide range of prompts as input to decide what exactly the user wants to be segmented, and it processes these prompts at very low compute requirements. I think SAM is very well designed architecture and I'm not sure how better it can be. I mean coming back to your question, there should be some signal that user wants a segmentation of laptop. SAM takes exactly that as prompt input.
- yazzku 4y agoI don't know much about this field, but are the segments given as a list or with more structure, e.g., a tree? If the keys are given as children to the laptop, then I don't think breaking things down in detail would get in the way of a user.
- deleted 4y ago[deleted]