You can still decode starting at a non-keyframe, and just apply the diffs to the current picture, although the results might not be understandable; VLC is know

You can still decode starting at a non-keyframe, and just apply the diffs to the current picture, although the results might not be understandable; VLC is known for doing this when seeking.