3 ms·
Does Xiph have an official position on objective metrics for video codecs? I'd imagine that what you choose to measure might make a big difference at this earl
by ZeroGravitas 13y ago
Does Xiph have an official position on objective metrics for video codecs?
I'd imagine that what you choose to measure might make a big difference at this early design stage, and from a purely practical point of view, an "outsider" codec needs to prove itself against the incumbents via benchmarks unless it is night and day better (and even then the incumbents can muddy the waters with carefully chosen benchmarks).
The online peanut gallery debate on this seems to have degenerated into a sports fan like clash between SSIM afficiandos and people who think PNSR is good enough. But since the two measures are highly correlated with each other and both are based on treating video as a series of still images it sometimes it seems like two very short twins arguing about who is taller. The Xiph write-ups have a good track record of cutting through the BS and illuminating good engineering practice so I'd be interested in hearing their take.
A recent paper suggested that all such frame-based metrics heavily underestimated the improvements between H264 and HEVC compared with subjective MOS ratings. As an "odd" codec design that intentionally strays from the MPEG orthodoxy it seems like Daala could have a correspondence between objective and subjective quality measures that differs radically from existing codecs.