5 ms·

Facebook releases ResNeXt for image classification and object detection

118 points by jimarcey 10y ago

thansharp 10y ago
The main person behind Microsoft's award winning ResNet, Kaiming He, left for Facebook AI research last year. This work looks like it builds upon the previous work done on Residual Networks (ResNet).
daadaa 10y ago
Facebook is really freaking me out. They broke every privacy law and still they are not procecuted ? They spy, hide, block peoples accounts, but still ... STILL people want to use fb ?
2bitencryption 10y ago
fun fact: if you inspect the properties of images hosted on facebook, you can see an html attribute for tags that Facebook has determined are in the photo (like "two people smiling," "pool", "outdoor party", "dog", etc). As far as I know this isn't used for any user-facing features (yet), but it's there.
- Narretz 10y ago
  This is useful for screen readers.
- SoapSeller 10y ago
  http://www.theverge.com/2017/2/2/14486034/facebook-ai-update-photo-search-by-keyword http://www.theverge.com/2017/2/2/14486034/facebook-ai-update...
- amelius 10y ago
  It doesn't seem to be really accurate. E.g., for a cartoon it says: "Image may contain: text".
  - gwern 10y ago
    Most of the image datasets are exclusively photo-based. (Definitely no anime in ImageNet, MSCOCO, SVHN, CIFAR etc.) I've noticed that many computer vision tools seem to do worse on drawings or cartoons. The other day I was putting together a dataset of anime headshots to try to generate them with WGAN, and needed to crop images down to just the faces; the usual OpenCV tools failed utterly, and I had to use an anime-specific face detection library.
  - dirtyaura 10y ago
    Cartoons are a special snowflake: Jeremy Howard said in the fast.ai course that you probably need to retrain multiple layers of convolutional network to handle them. I.e you have a different model for them than for photos.
  - deleted 10y ago
    [deleted]
- kevan 10y ago
  It's been showing up in my alt tags for a while.
deepnotderp 10y ago
Awesome, I've tried to reproduce this paper's results to no avail, and had similar reports from other redditors.
augustt 10y ago
Does this do object detection as the title suggests? From the README, it seems like it only does classification.
vrbelli 10y ago
Does anyone know what is the current state of 3D object recognition using Shapenet for example? I imagine there must be progress on this in the AR industry.

118 points by jimarcey 10y ago

The main person behind Microsoft's award winning ResNet, Kaiming He, left for Facebook AI research last year. This work looks like it builds upon the previous work done on Residual Networks (ResNet).

daadaa 10y ago

Facebook is really freaking me out. They broke every privacy law and still they are not procecuted ? They spy, hide, block peoples accounts, but still ... STILL people want to use fb ?

2bitencryption 10y ago

fun fact: if you inspect the properties of images hosted on facebook, you can see an html attribute for tags that Facebook has determined are in the photo (like "two people smiling," "pool", "outdoor party", "dog", etc). As far as I know this isn't used for any user-facing features (yet), but it's there.

Narretz 10y ago
This is useful for screen readers.
SoapSeller 10y ago
http://www.theverge.com/2017/2/2/14486034/facebook-ai-update-photo-search-by-keyword http://www.theverge.com/2017/2/2/14486034/facebook-ai-update...
amelius 10y ago
It doesn't seem to be really accurate. E.g., for a cartoon it says: "Image may contain: text".
- gwern 10y ago
  Most of the image datasets are exclusively photo-based. (Definitely no anime in ImageNet, MSCOCO, SVHN, CIFAR etc.) I've noticed that many computer vision tools seem to do worse on drawings or cartoons. The other day I was putting together a dataset of anime headshots to try to generate them with WGAN, and needed to crop images down to just the faces; the usual OpenCV tools failed utterly, and I had to use an anime-specific face detection library.
- dirtyaura 10y ago
  Cartoons are a special snowflake: Jeremy Howard said in the fast.ai course that you probably need to retrain multiple layers of convolutional network to handle them. I.e you have a different model for them than for photos.
- deleted 10y ago
  [deleted]
kevan 10y ago
It's been showing up in my alt tags for a while.

deepnotderp 10y ago

Awesome, I've tried to reproduce this paper's results to no avail, and had similar reports from other redditors.

augustt 10y ago

Does this do object detection as the title suggests? From the README, it seems like it only does classification.

vrbelli 10y ago

Does anyone know what is the current state of 3D object recognition using Shapenet for example? I imagine there must be progress on this in the AR industry.