3 ms·
There are secondary non-obvious effects of caching and queueing. Cold start is an important scenario that lots of people overlook - “we won’t restart it during
by efitz 5y ago
There are secondary non-obvious effects of caching and queueing.
Cold start is an important scenario that lots of people overlook - “we won’t restart it during busy times”, etc. however if you have a bug or outage then that might be precisely when you restart. During a cold start you will often find your system behaves as it does at the tails of the performance curve, either because you are getting 100% cache misses, or because all your queues are full due to a client pile-on or queued upstream work, or some combination.
The article described back pressure; I can’t emphasize that enough as part of any resilient queuing system. Chains of queues are only as performant as their weakest link.