3 ms·
There will be a latency and CPU usage penalty every time a new instance is invoked to serve requests.
by riobard 16y ago
There will be a latency and CPU usage penalty every time a new instance is invoked to serve requests.
- StavrosK 16y agoAh, true. Isn't there a warmup request to the instance first, though, that takes care of the import latency? The CPU usage penalty might be worth the tradeoff for some people.