2 ms·
Only if that system is stateless. If you have any sort of internal memory that sticks around between requests, then either you face a cold start problem (becau
by hunterpayne 1y ago
Only if that system is stateless. If you have any sort of internal memory that sticks around between requests, then either you face a cold start problem (because of empty caches) or you somehow need to persist that state somewhere. And persisting that state either means you need a backup solution or your latency is terrible because you are hitting network for something that only needs to hit RAM.