What are the technical challenges involved with building a high quality, low-latency bit of hardware? Even small lags in response are really annoying and kill e

What are the technical challenges involved with building a high quality, low-latency bit of hardware? Even small lags in response are really annoying and kill enjoyment of the game for me.