4 ms·
Norc isn't meant as a replacement for any queuing system, rather a replacement for Cron. We use Norc in conjunction with SQS, and find the former is good for s
by darrellsilver 17y ago
Norc isn't meant as a replacement for any queuing system, rather a replacement for Cron.
We use Norc in conjunction with SQS, and find the former is good for scheduling, management, logging, while SQS is better for lots and lots of repetitive tasks that we want processed ASAP.
Perpetually.com crawls, archives and versions any web site on demand, with any repeating schedule. One of the challenges is managing bursts of activity, so what we do is use Norc to manage the timing of archive requests, then SQS to manage farming out the actual archiving to available hosts. Since we hook SQS into Norc we can easily monitor/audit any system delay or outage.
We also use it to handle system backups, sending alerts and other system administration tasks.
- hapless 17y agoSo it's a hybrid between a batch job processor and cron? Batch cron?
- deleted 17y ago[deleted]
- deleted 17y ago[deleted]