4 ms·
Title is misleading. Nvidia have created a network which can slow down (i.e. interpolate) videos by a factor of four. Actual link: https://news.developer.nvidi
by joshvm 8y ago
Title is misleading. Nvidia have created a network which can slow down (i.e. interpolate) videos by a factor of four.
Actual link: https://news.developer.nvidia.com/transforming-standard-video-into-slow-motion-with-ai/ https://news.developer.nvidia.com/transforming-standard-vide...
Most importantly, the footage shot in the video was at 2500 fps native [1] - at 300k FPS you have to use a significantly reduced image size. FPS is bottlenecked by the time it takes to read out the sensor, which is linear in the number of rows in the image. So if you read out half the sensor, you can double your frame rate. You can exploit this to get thousands of frames per second on a cheap machine vision camera.
The camera framerate is largely irrelevant. While you can slow down footage by four times (neat), that doesn't mean you can get 300k fps footage out of a compact camera. The great benefit of this technique is really that you can convincingly fake super-slow motion without having to sacrifice sensor resolution. I can easily see this as a cool iOS or Android feature.
Maybe if they'd actually used footage that was at the limit of camera technology this would be more impressive (I don't see a technical reason why not?). Why not combine it with super resolution too? Interesting security implications, as cameras with frame rates higher than (I believe) 1M fps are ITAR controlled.
[1] https://www.youtube.com/watch?v=5mZovjRlkWs https://www.youtube.com/watch?v=5mZovjRlkWs
- dvfjsdhgfv 8y ago> as cameras with frame rates higher than (I believe) 1M fps are ITAR controlled. I'm curious what's the reason for that. I can understand that extremely high resolution could be used for intelligence purposes/high quality satellite images, but high frame rates?
- joshvm 8y agoThe UK government has a great website for this, where you can look up restricted things and the reason for the restriction. Search for "frames". Mostly it's because they're used for ballistics and weapons imaging. They're listed under item 6A003 (broadly, cameras) on the export list which includes: - Cinema cameras with frame rates more than 13,150fps - Mechanical/electronic cameras with frame rates more than 1M fps - Frame readout speeds of more than 125 fps full frame. The last one is interesting, you can buy machine vision cameras with higher frame rates fairly easily, so perhaps it's only something to worry about if you're traveling. https://www.ecochecker.trade.gov.uk/spirefox5live/fox/spire/ https://www.ecochecker.trade.gov.uk/spirefox5live/fox/spire/