3 ms·
I tend to believe that one of the most powerful things about Dynamo is the streaming capabilities. It means that you can cleanly use Dynamo as the source of tru
by 013a 8y ago
I tend to believe that one of the most powerful things about Dynamo is the streaming capabilities. It means that you can cleanly use Dynamo as the source of truth for your data, reap all of the performance benefits it has, and automatically ship that data to another database for more advanced BI querying. Moreover, you can do this offline; queue up every mutation that hits Dynamo, then process them at a rate that your data warehouse can ingest without worrying about overprovisioning for spikes.
I've worked on a team of 8 engineers that spent 6 months building a streaming replication system from MySQL to Redshift. Its crazy how simple this would have been had the originating database been Dynamo; its very possible one engineer could have done it in a fraction of the time. It also seems likely to me that an open source solution might already exist.