4 ms·
Most people use Sidekiq which uses Redis for ActiveJob. If there was an Lambda backend then you could get rid of Redis.
by dyeje 8y ago
Most people use Sidekiq which uses Redis for ActiveJob. If there was an Lambda backend then you could get rid of Redis.
- ryanmarsh 8y agoYou won’t need Sidekiq either.
- bpicolo 8y agoSidekiq has other useful features (like the built in dashboard)
- scarface74 8y agoThat’s what CloudWatch is for....
- jm547ster 8y agoCloudWatch is an awful tool to have to use
- scarface74 8y agoDon’t get me wrong, I’m no savage. I use structured JSON logging with Serilog and use ElasticSearch as a sink with a Kibanna for most of my app logging. I also log to Cloudwatch though and keep those logs for maybe a week.
- dyeje 8y agoYes, you wouldn't use Sidekiq anymore either because you would have a different ActiveJob backend, but the important part is that you're eliminating a piece of infrastructure (Redis) without the the poor scalability of DelayedJob.
- deleted 8y ago[deleted]
- foota 8y agoDoes the 15 minute limit not apply anymore? That might be a blocker.
- scarface74 8y agoYes. But there is an easy way around it. If you can break your process up into chunks that run less than 15 minutes, you can have all of your steps in different methods, and use Step Functions to orchestrate it. You will usually be using the same lambda instance since you are calling the same function. https://aws.amazon.com/step-functions/ https://aws.amazon.com/step-functions/ Basically you define your steps with an input to each step (all of the below is psuedocode of course$ : Step 1: {“Event”:”step a”} Step 1: {“Event”:”step b”} Step 1: {“Event”:”step c”} And define the handler in your lambda: Switch event: Case “step a” DoA() Case “step b” DoB() Case “step c” DoC() I’ve had a lambda run for two hours doing this.
- mattbillenstein 8y ago"easy way" wtf
- scarface74 8y agoA JSON file and a case statement is hard? You can even validate the JSON as you’re creating it in the console. Not just validating correct JSON, but validating that it is a correctly formatted state machine. Anyone who can’t handle creating the step function and a case statement is going to have a heck of time using Terraform, CloudFormatiom, creating IAM policies, yml files for builds and deployments, etc.
- mattbillenstein 8y agoJust run the stupid thing on a VM for however long it takes, why would anyone need all this complexity to run some dumb program that should just be a cron job to begin with. And why should the limitations of some platform dictate how one structures their code to begin with? You're solving for the wrong problem.