When people say IO bound in this sense, they mean that's the lower bound on what your users experience: 4G latency 50ms AWS inter AZ latency 1ms Thread conte

When people say IO bound in this sense, they mean that's the lower bound on what your users experience: 4G latency 50ms AWS inter AZ latency 1ms Thread context switch 2us The response times from things like search APIs even at FANG companies with vast resources and highly skilled engineers are often in the hundreds of milliseconds.