4 ms·

Correct me if I'm wrong, but this is just a frame-by-frame labeling. You can download whatever pre-trained CNN, pass individual frames through it and get the sa

Correct me if I'm wrong, but this is just a frame-by-frame labeling. You can download whatever pre-trained CNN, pass individual frames through it and get the same result.

skewart 10y ago
True. But then you have to deploy and maintain that CNN yourself. The value prop is similar to, say, Twilio. Though, arguably, it's easier to run your own pre-trained CNN than it is to replicate the telephony, VoIP, and video conferencing stuff Twilio provides. Also, presumably Google is hoping that they can continue to train and improve their CNN so that it's always just a little better than the best free-to-download ones.
- ar15saveslives 10y ago
  Yes, but I mean if you analyze video as individual frames, you can't declare "we do video analysis", because video is completely different domain. There're papers like [1] where CNN output is used as input for RNN, which performs deeper context analysis. Results aren't exciting, though. [1] http://cs231n.stanford.edu/reports2016/221_Report.pdf http://cs231n.stanford.edu/reports2016/221_Report.pdf
robotresearcher 10y ago
I don't know if they are doing it right now in this API, but Google and plenty of others have demonstrated recognition of actions in videos. I expect they'll add it later if it's not there right now. At the very least in this release they are identifying scene changes, which is a dynamic property.
pgodzin 10y ago
It also mentions verbs like swimming so it may do those across several frames? Not sure how much more accurate that is than frame-by-frame
- ar15saveslives 10y ago
  I suspect it's not a detected action, but just a picture labeled "swimming", like one of these (random image from internet): http://www.ambientegallerie.com/blog/wp-content/uploads/2016/07/swimming.jpg http://www.ambientegallerie.com/blog/wp-content/uploads/2016...

4 ms·

Correct me if I'm wrong, but this is just a frame-by-frame labeling. You can download whatever pre-trained CNN, pass individual frames through it and get the sa

by ar15saveslives 10y ago

Correct me if I'm wrong, but this is just a frame-by-frame labeling. You can download whatever pre-trained CNN, pass individual frames through it and get the same result.

skewart 10y ago
True. But then you have to deploy and maintain that CNN yourself. The value prop is similar to, say, Twilio. Though, arguably, it's easier to run your own pre-trained CNN than it is to replicate the telephony, VoIP, and video conferencing stuff Twilio provides. Also, presumably Google is hoping that they can continue to train and improve their CNN so that it's always just a little better than the best free-to-download ones.
- ar15saveslives 10y ago
  Yes, but I mean if you analyze video as individual frames, you can't declare "we do video analysis", because video is completely different domain. There're papers like [1] where CNN output is used as input for RNN, which performs deeper context analysis. Results aren't exciting, though. [1] http://cs231n.stanford.edu/reports2016/221_Report.pdf http://cs231n.stanford.edu/reports2016/221_Report.pdf
robotresearcher 10y ago
I don't know if they are doing it right now in this API, but Google and plenty of others have demonstrated recognition of actions in videos. I expect they'll add it later if it's not there right now. At the very least in this release they are identifying scene changes, which is a dynamic property.
pgodzin 10y ago
It also mentions verbs like swimming so it may do those across several frames? Not sure how much more accurate that is than frame-by-frame
- ar15saveslives 10y ago
  I suspect it's not a detected action, but just a picture labeled "swimming", like one of these (random image from internet): http://www.ambientegallerie.com/blog/wp-content/uploads/2016/07/swimming.jpg http://www.ambientegallerie.com/blog/wp-content/uploads/2016...