3 ms·
Interesting. Are cold starts such a good problem? Cold starts with Node (Javascript) seems to be around 200ms. But the best thing would probably be to have it
by elitan 6y ago
Interesting. Are cold starts such a good problem? Cold starts with Node (Javascript) seems to be around 200ms.
But the best thing would probably be to have it as an option. Scale down to 0 (cold starts) or 1 (no cold starts).
- nicoburns 6y ago200ms would likely be fine (although not ideal), but I've seen more like to 3000ms with Firebase Cloud Functions, and have heard stories of similar with AWS Lambda. The fundamental problem seems to be the VM-or-container-per-request model. That means as soon as you get an extra concurrent user you have another cold start even if you already had one resource going. Whereas with a classic backend one server (even a small one) can handle thousands of concurrent requests and thus you have plenty of breathing room to start up another server before the current one gets completely bogged down.