Is it possible that there is a delay for one-off unanticipated events, but the feedback loop we form between perception and playing is much tighter? I definite

Is it possible that there is a delay for one-off unanticipated events, but the feedback loop we form between perception and playing is much tighter? I definitely have a hard time playing anything with much more than 5ms audio buffers myself.