5 ms·
Ask HN: What tech to run and monitor CRON jobs (Python, Node.js, C#)?
- LikeAnElephant 5y agoRegarding monitoring: I've come to rely on healthchecks.io to ensure my cron jobs when like I expect.
- XCSme 5y agoI use the same service and I think it works, no CRON job failed yet though.
- jorislacance 5y agoMonitoring solved, how do you deal with the CICD/delivery of your CRON code then?
- vyrotek 5y agoHow long of a job do you need to run? We use Azure Timer Functions and/or Logic Apps to run and monitor our jobs. All of those languages are supported.
- jorislacance 5y agoFrom 5 minutes to 24h mainly. Some jobs have crazy deps, like puppeteer or selenium, I wonder if you can setup complex environment dependencies with FaaS (docker base image maybe?)
- zbentley 5y agohttps://deadmanssnitch.com/ https://deadmanssnitch.com/
- recov 5y agoA little overkill, but airflow. Free, has history, language agnostic, retries, can handle a large number of time based tasks.
- jorislacance 5y agoVery big data alternative!
- threecheese 5y agoMany teams use Rundeck for scheduled jobs and runbook automation. It gives you a nice UI and a measure of governance around the process. https://docs.rundeck.com/docs/learning/ https://docs.rundeck.com/docs/learning/
- jorislacance 5y agoI didn't know this one, I'll take a look at it, thanks!
- ezekg 5y agoI run cron jobs using sidekiq-cron and monitor them using https://cronitor.io https://cronitor.io.
- jorislacance 5y agoI found it quickly, but language tied (ruby in this case) :/
- rahimnathwani 5y agocrontab to run them dogwrap (command-line tool for datadog) to monitor them
- jorislacance 5y agointerested about dogwrap, seems very generic for a various cases. How do you deal with the CICD/delivery of your CRON code then using crontab?
- chudi 5y agoRundeck is a pretty good tool to schedule, save logs and the like. At my work we have a rundeck server connect via ssh to differents vm and execute the script there, you can configure alarms, parallel execution, plenty of steps it's pretty good you should try it out.
- jorislacance 5y agoI didn't know this one, I'll take a look at it, thanks!
- rozenmd 5y agoThere are SaaSes for this, like https://cronhub.io https://cronhub.io
- jorislacance 5y agoWe are considering. but it makes us migrate all 'stupid' jobs into API that can be triggered from cronhub.io.
- aprdm 5y agoJenkins can work quite well for this. It keeps logs, success/failure, has hooks for multiple notifications and etc.
- jorislacance 5y agothat's sadly what we do nowadays, but this is quite an hack somehow; there are hard limits in the monitoring features, not a lot of overview analytics viz too. Our core issue is that it is a too much tech software, we would like to have PM/PO looking at the health status of things. We could build a dashboard about jobs status elsewhere for sure. But we are hoping to find a better tech to deliver, run and monitor jobs, all in one.
- aprdm 5y agoYou can template/customize the job view quite a lot in jenkins with HTML. We found it an OK compromise. It has prometheus plugins for monitoring
- jorislacance 5y agoWoh! golden feedback, we should look at doing this too. Appreciate your follow up thanks you!