4 ms·

Either download ahead, or turn down the bitrate via ytdl format expressions; see the latter's docs for how to express your desires.