Having that many connections requires tons of buffering and effectively manual scheduling (or clients can experience latency issues). At the very least non-bloc

Having that many connections requires tons of buffering and effectively manual scheduling (or clients can experience latency issues). At the very least non-blocking io allows to tune the scheduling depending on the clients behavior and importance. Personal experience: tons of java nio and lock-free structures.