3 ms·
Interesting but how do we know the examples are not cherry-picked?
by person_of_color 8y ago
Interesting but how do we know the examples are not cherry-picked?
- gwern 8y agoWell, first, Nvidia has a good track record. This is not their first video-to-video paper, and they've also released impressive things like ProGAN; they release not just the source code, but trained models as well. People have trained their own models (slowly) and poked at the released models. The average result might not be quite as good, but they'll be close. Second, in this case, they've also released source code and the trained models. The trained models aren't in the Github repo, but hosted on Google Drive and they provide scripts for downloading them: https://github.com/NVIDIA/vid2vid/tree/master/scripts https://github.com/NVIDIA/vid2vid/tree/master/scripts If you are doubtful, simply install Pytorch, download the models, and give the video generation a try. (You don't need a GPU, even, since for generating some samples once, a CPU will be acceptably fast.)
- screye 8y agoWait, this algorithm works at real-time on consumer grade hardware ? I am impressed. I thought a forward pass for the model would be a lot more expensive than that.
- gwern 8y agoI never said it was realtime. I said it was acceptably fast on CPU ie. it'd take a few minutes/hours to generate some samples and convince yourself that they did not cherrypick a tiny handful of good quality samples out of a universe of lousy ones. I would very roughly guesstimate their 2000px model probably would take ~0.5s/frame on a GPU, so multiply by the usual >10x CPU slowdown, you can generate a 30fps 30s snippet in maybe an hour or so.