4 ms·
"AutoSys is a closed, proprietary system, and SQS / RabbitMQ are queueing systems, without support for scheduling." Right, why would a message queue support sc
by jcapote 17y ago
"AutoSys is a closed, proprietary system, and SQS / RabbitMQ are queueing systems, without support for scheduling."
Right, why would a message queue support scheduling?
- darrellsilver 17y agoNorc isn't meant as a replacement for any queuing system, rather a replacement for Cron. We use Norc in conjunction with SQS, and find the former is good for scheduling, management, logging, while SQS is better for lots and lots of repetitive tasks that we want processed ASAP. Perpetually.com crawls, archives and versions any web site on demand, with any repeating schedule. One of the challenges is managing bursts of activity, so what we do is use Norc to manage the timing of archive requests, then SQS to manage farming out the actual archiving to available hosts. Since we hook SQS into Norc we can easily monitor/audit any system delay or outage. We also use it to handle system backups, sending alerts and other system administration tasks.
- hapless 17y agoSo it's a hybrid between a batch job processor and cron? Batch cron?
- deleted 17y ago[deleted]
- deleted 17y ago[deleted]
- sophacles 17y agoThe answer is in the article: While cron is great, it’s not geared toward solving this problem: Tasks are tied to a single computer, and they’re managed independently for each host and user from the command line.