4 ms·
> Profile the function that is called if object is not found in cache ? Have pluggable cache with plugin that just doesn't cache? That is not hard problem to so
by TeMPOraL 4y ago
> Profile the function that is called if object is not found in cache ? Have pluggable cache with plugin that just doesn't cache? That is not hard problem to solve.
The more the dynamic behavior of the profiled system and the real system deviate, the harder it is to isolate what's causing the slowdowns.
> Well, they delivered (I'm guessing) 10x improvement in a month by adding cache.
Yes, but by doing this they also tremendously increased the complexity of the project, and (unless the team has someone like GP in it) prevented further optimizations. It may still be a good trade-off, but the overall sorry state of pretty much all software everywhere suggests it may not be a good one usually.
> And frankly ability to use profiler and knowing some architectural optimizations seems to be pretty rare skill.
That's kind of reinforcing the parent's point, though.
- zasdffaa 4y ago> The more the dynamic behavior of the profiled system and the real system deviate Maybe. I've never found it a problem, but maybe. When I've added a cache, the cache comes with instrumentation for exactly that. > Yes, but by doing this they also tremendously increased the complexity of the project It depends. EG if you don't need to worry too much about cache invalidation, adding caching can be as simple as adding a single function call eg like python's lru_cache. It depends on the use case.
- ilyt 4y ago>> Profile the function that is called if object is not found in cache ? Have pluggable cache with plugin that just doesn't cache? That is not hard problem to solve. >The more the dynamic behavior of the profiled system and the real system deviate, the harder it is to isolate what's causing the slowdowns. Whose quote you repeat without thinking ? It's not that relevant if you know how profiling works... >> Well, they delivered (I'm guessing) 10x improvement in a month by adding cache. >Yes, but by doing this they also tremendously increased the complexity of the project Not really in most cases its pretty simple to add it, and if you profiled correctly you'd start with only adding extra code in hottest part of the app > and (unless the team has someone like GP in it) prevented further optimizations. Uh, just no. It might've fixed problem well enough to not be touched but it ain't stopping anything, just a different solution. > It may still be a good trade-off, but the overall sorry state of pretty much all software everywhere suggests it may not be a good one usually. The assumption here that the same developers that fucked up caching would somehow manage to achieve same speedup with "just" optimizations and less bugs is bold one. Hell, many low level optimizations are also basically "using cache" (but CPU one) well, althought compiler usually gets you out of most egregious mistakes (unless you decide to write multithreaded C/C++ carelessly I guess. >> And frankly ability to use profiler and knowing some architectural optimizations seems to be pretty rare skill. > That's kind of reinforcing the parent's point, though. What point exactly ? That average developer is bad at their job ? Poster above explicitly said that the worse developers claimed it can't be optimized more in the first place, what else you expect from them ? Cache was the most cost-efficient solution most likely.