3 ms·
Direct memory mapping from NIC to userspace with a userspace TCP/IP stack can significantly accelerate ultra low latency processing. The effect basically disap
by pstrateman 11y ago
Direct memory mapping from NIC to userspace with a userspace TCP/IP stack can significantly accelerate ultra low latency processing.
The effect basically disappears when you're looking at webpages that take 10-1000ms to generate.
- RyanZAG 11y agoAgreed, as soon as per-request processing becomes a large portion of the work it will dwarf these types of optimizations. The article is talking specifically about "simple one-page performant servers that easily get into the 100k requests/second territory", which can see very large throughput increases with direct NIC access.
- geocar 11y agodash[1] is a dynamic webserver that uses the logic described in the article (content logic is in Q/KDB). I have considered writing a userspace TCP HTTP server like the one you suggest, but it would be a demonstration of how to write a state machine and not how to better use the facilities that the operating system provides for writing a server. [1]: https://github.com/geocar/dash https://github.com/geocar/dash