3 ms·
> system getting 100s of requests per second you get better concurrency if you wait for entire payloads before you waste cache lines At what point should one s
by ignoramous 2y ago
> system getting 100s of requests per second you get better concurrency if you wait for entire payloads before you waste cache lines
At what point should one scale up & switch to chips with embedded DRAMs ("L4 cache")?
- hinkley 2y agoI haven’t been tracking price competitiveness on those. What cloud providers offer them? But you don’t get credit for having three tasks halfway finished instead of one task done and two in flight. Any failover will have to start over with no forward progress having been made. ETA: while the chip generation used for EC2 m7i instances can have L4 cache, I can’t find a straight answer about whether they do or not. What I can say is that for most of the services I benchmarked at my last gig, M7i came out to be as expensive per request as the m6’s on our workload (AMD’s was more expensive). So if it has L4 it ain’t helping. Especially at those price points.
- bruce343434 2y agoWhen you've profiled the code running in production and identified memory bottlenecks that can not be solved by algorithmic/datastructural optimizations.