3 ms·
I was planning on porting some short-lived but computationally intensive jobs to AWS Lambda. These run once per day so cost isn't an issue at all. The whole pla
by desdiv 10y ago
I was planning on porting some short-lived but computationally intensive jobs to AWS Lambda. These run once per day so cost isn't an issue at all. The whole plan fell apart when I found that Lambda doesn't support more than 2 concurrent threads[0].
Is there any service out there that does this? Basically I'm willing to pay $1 to rent a c4.4xlarge instance for just 1 minute. Keep in that the hourly rate of c4.4xlarge is only $0.621 on US East, so I'm willing to pay a huge premium here.
[0] http://stackoverflow.com/questions/34135359/whats-the-maximum-number-of-virtual-processor-cores-available-in-aws-lambda http://stackoverflow.com/questions/34135359/whats-the-maximu...
- reitzensteinm 10y agoWhy not just rent c4.4xlarge for one hour?
- desdiv 10y agoThink of it as a daily sales report. Sometime (any time) during day the admin user clicks a button which launches the job. The fastest I've seen an EC2 instance booting is about 45 seconds, which is too slow for my needs. A cold-start for Lambda is less than 100ms.
- boundlessdreamz 10y agoHave you tried Google Cloud. Performance & pricing (including booting) is much better on GCE than on AWS.
- hn_user2 10y agoHave you considered a cron lambda that breaks the task down into smaller parts and creates jobs for those parts onto SQS or SNS? Sounds like you already have smaller jobs since you are breaking up to threads. You could then have your worker lambdas being triggered off the SNS publication and doing the work.
- nzoschke 10y agoHerokus performance dynos might fit the bill. They are really fast to spin up. Joyent's Triton is pretty interesting for running one off docker containers though last time I tried it took a variable number of seconds to start one.
- desdiv 10y agoYep, this looks like exactly what I need. Thanks!
- shanemhansen 10y agoI'm interested in finding out more about your use case and why other offerings aren't working. You can email me at $username@gmail.com if you're willing to discuss this.