3 ms·
We run a very simple filesystem based queue that processes around 1 billion events a day. Makes use of XFS for it's better handling of large numbers of files.
by donatj 1y ago
We run a very simple filesystem based queue that processes around 1 billion events a day. Makes use of XFS for it's better handling of large numbers of files.
Corporate tried to push us to replace it with SQS and it could not keep up / costs with through the roof
- RedShift1 1y agoHow does it work? Can you have multiple workers on the same payload? Do you archive the events afterwards?