I like this. A nice, practical solution to a real problem! Disclaimer, I work for AWS. At some point there's just too many of these data streams, so a warehous

I like this. A nice, practical solution to a real problem! Disclaimer, I work for AWS. At some point there's just too many of these data streams, so a warehouse no longer does it and we turn to data lakes. The advanced version of what the OP is trying to achieve, without any actual manual work, could be an AI, and be called Lake Formation, https://aws.amazon.com/lake-formation https://aws.amazon.com/lake-formation.