One important thing about performance is that guaranteeing good throughput and latency are two separate things. I read all the books, all the blogposts and pap

One important thing about performance is that guaranteeing good throughput and latency are two separate things. I read all the books, all the blogposts and papers; trust me, I did the obvious things. Even if you make your data structures tight, the problem isn't so much that the program runs slow on average. The problem is that it is hard to predict the runtime performance characteristics, let alone guarantee them.