I'm finding Sqlite DBs in S3 to be a great solution for ETL tasks. It's a project where multiple other applications want to process data produced by my applica

I'm finding Sqlite DBs in S3 to be a great solution for ETL tasks. It's a project where multiple other applications want to process data produced by my application. Instead of forcing them to make API calls to retrieve all of the data and all the network overhead and latency that entails, periodically write Sqlite DBs to S3 and post an event that the database is available. Can create one database per customer, or whatever your natural partition key is. Then it's just pull the database to local disk, pull all the data you need with SQL queries, and delete from the bucket when every client has had a chance to process it. I believe it offers much better throughput than going through an API.