4 ms·
I suspect they could do a fair bit. An obvious thing is that they look for this pattern of behavior and turn up the speed with which they kill processes. They'r
by wpietri 6y ago
I suspect they could do a fair bit. An obvious thing is that they look for this pattern of behavior and turn up the speed with which they kill processes. They're still meeting their terms, and the normal Java users never notice.
A more subtle thing is just to tune the lambda eviction code to be aware of profitability. The instances that get evicted first are the least profitable, the ones that have the worst ratio of billable to unbillable GB-miliseconds. Good customers get good performance. And the other ones say, "Gosh, cold starts are expensive; I'd better pay extra for provisioned concurrency."
- jacobr1 6y agoI've been toying with the idea of using some form of memory suspension. The theoretic cost of a cold start them becomes just the time it takes to rematerialize the memory from disk. Has anyone seen anything similar out there that could be a starting point?