3 ms·
Codecs like AV1 do a LOT of motion and transformation detection. That's generally where a lot of that ram goes, They are storing a metric ton of matrix data fr
by cogman10 7y ago
Codecs like AV1 do a LOT of motion and transformation detection. That's generally where a lot of that ram goes, They are storing a metric ton of matrix data from prior (and future? I'm not sure if AV1 does this) frames so that when calculating the current frame stream they can quickly look up that info.
Needless to say. figuring out which piece of data should be plucked out and transformed from prior frames is really computationally expensive.
Here's a paper on exactly what sort of tools are available for the codec.
https://jmvalin.ca/papers/AV1_tools.pdf https://jmvalin.ca/papers/AV1_tools.pdf
edit I should note that the data stream for H.264 is FAR simpler. It doesn't support nearly the number of transformations that AV1 does.