If you just try to find a ball on static image by static image you're going to have a bad time. This isn't the point you were making, but as an aside, I think

If you just try to find a ball on static image by static image you're going to have a bad time. This isn't the point you were making, but as an aside, I think converting video into static images is throwing away useful information. Most video codecs work by encoding the changes between video frames which includes movement information. It seems hard, but worthwhile, to use this information for object recognition. I just did a search and saw that these techniques go by the name "compressed domain analysis" [1]. [1] https://scholar.google.com/scholar?hl=de&as_sdt=0%2C5&q=compressed+domain+analysis&btnG= https://scholar.google.com/scholar?hl=de&as_sdt=0%2C5&q=comp...