5 ms·
> For serverless technologies to "win" they have to solve the "cold start" problem. I've said here and elsewhere before that autoscaling is easy to say and har
by jacques_chester 8y ago
> For serverless technologies to "win" they have to solve the "cold start" problem.
I've said here and elsewhere before that autoscaling is easy to say and hard to do.
We keep looking to autoscalers to divine our economic preferences, which they cannot do for us. What's been missing is the ability to explicitly trade off latency for expense.
The best you can do is to a) attack startup time any how, any way possible, b) react sanely to unexpected traffic changes, c) make reasonable forecasts and d) explicitly tune cost of idleness vs cost of delay vs probability of delay. These help, but the problem will never fully go away.
(Unless you've discovered an escape hatch from either of causality or integral calculus. If you have, please share it with the class.)