2 ms·
You should look at Netflix engineering blog/usenix papers about their CDN appliances. In the latest instance types their main bottleneck is physical memory band
by toast0 5y ago
You should look at Netflix engineering blog/usenix papers about their CDN appliances. In the latest instance types their main bottleneck is physical memory bandwidth. I'm fairly sure they mention profiling tools which would be useful for you to verify your assumptions (assuming they work in your environment) as well as hardware details if you want to build a similar system.
I think Epyc 7313 processors are likey a good fit if you are ram bandwidth limited though. Zen3, lowest core count, but still has all the ram channels. There's a lower cost single socket version too.
Can you tell us more about the data dependencies between threads? If there's contention on the shared memory, that's a more likely bottleneck than raw bandwidth.