3 ms·
> why can’t we just dump a file of what we need to bill on S3, and have a CRON job pick it up and collect payment? Sounds like an engineer with not enough expe
by WirelessGigabit 3y ago
> why can’t we just dump a file of what we need to bill on S3, and have a CRON job pick it up and collect payment?
Sounds like an engineer with not enough experience. We all did thought like this once.
This is a solved problem. Don't roll your own queue / job system where you inevitably run into transactional problems. Use something like Airflow.
And mentioning S3 in this sentence has no value. S3 is merely a way to store the data temporarily. But using S3 immediately makes us not consider (more suitable) alternatives.