That doesn't work for us (beyond the first stage), because the fields we extract from the original source are not ephemeral. We need to store the key/value pai

That doesn't work for us (beyond the first stage), because the fields we extract from the original source are not ephemeral. We need to store the key/value pairs and explore them in a reasonably productive fashion (i.e using queries) in order to come up with machine learning algorithms. And any new algorithms we write need access to all historical data.