6 ms·
Cold start performance is improving significantly as the Lambda fleets migrate to Firecracker technology: https://aws.amazon.com/blogs/aws/firecracker-lightweig
by otterley 8y ago
Cold start performance is improving significantly as the Lambda fleets migrate to Firecracker technology: https://aws.amazon.com/blogs/aws/firecracker-lightweight-virtualization-for-serverless-computing/ https://aws.amazon.com/blogs/aws/firecracker-lightweight-vir...
- saosebastiao 8y agoCold starts for the VM are only part of the problem. If you're on a JITed runtime, a cold start also means compilation and optimization. It would be nice if they had ways to cache the JITed machine code so they could start back up with it already compiled and optimized.
- deleted 8y ago[deleted]
- kondro 8y agoModern lambdas can be paused for 4+ hours before experiencing cold starts (depending on a lot of variables). AWS is making continual improvements in this area.
- hn_throwaway_99 8y agoAnyone know if there have been any improvements to cold start times for Lambdas in a VPC? That was the absolute death knell for us. If you're using Lambdas as a service backend for mobile/web apps, it's extremely common those Lambdas will be talking to a DB, and any decent security practice would require that DB to be in a VPC. Cold starts for Lambdas in a VPC could be on the order of 8-10 seconds: https://medium.freecodecamp.org/lambda-vpc-cold-starts-a-latency-killer-5408323278dd https://medium.freecodecamp.org/lambda-vpc-cold-starts-a-lat...
- staticassertion 8y agoAgreed! I'm much more concerned with VPC performance - I don't have a single lambda outside of a VPC. Firecracker is extremely cool, and I'm very glad to see the improved perf at the VM level, but that's not my bottleneck. Thankfully, in my case, I have a very steady flow of data so I don't expect too many cold starts.
- Tehnix 8y agoI know that they are actively looking at it. One thing though, does your lambdas need both public and private access? Else you can place them in a subnet for private only, since the slow part is the ENI for the Nat Gateway.
- staticassertion 8y agoThey all need to access S3, which I believe requires public.
- djm_ 8y agoThey're working on it, coming in 2019 (announced today) [1] [1] https://twitter.com/jeremy_daly/status/1068272580556087296 https://twitter.com/jeremy_daly/status/1068272580556087296
- dopylitty 8y agoI just got out of a session at re:invent where they covered that they were working on improving VPC cold start times by reducing the amount of time it takes to associate an ENI with your lambda function. The method they're using also reduces the number of IPs needed to 1 per subnet.
- Afraithe 8y agoWe recently had to abandon Lambdas, 10+ second cold start, and for some reason when adding an API Gateway you get another +200ms on each request (Google it, common issue apparently). So, 10+ seconds cold start, and 200 + 200-300ms (around 500-600ms avg) calls to the Lambda function. Complete garbage for our application at least (I imagine using it for background processing might not be an issue with latency). Switched over to EC2, less than 200ms response total, no cold starts.