3 ms·
Maybe I'm missing something, but what I need (and what the data team at my company spectacularly fails to deliver) is fast access to post-ETL data as well as pr
by Traster 5y ago
Maybe I'm missing something, but what I need (and what the data team at my company spectacularly fails to deliver) is fast access to post-ETL data as well as pre-ETL data. I need the raw data sometimes, I need the processed data sometimes. What I get instead is no access to the raw data, and broken/slow/uninsured access to the processed data. I don't know about other people but in general I think a decent data warehouse would make me happy and the aspiration to be a datalake is what causes the data team to make me unhappy - they fail to provide the basics because they've heard too many buzzwords.
- tzsdata 5y agoWe use a data vault architecture as the raw/semi-structured source for a 'traditional' data warehouse built on Snowflake. Data vault gives more advanced users access to the raw data and Snowflake gives us all the scalability we need in terms of data volume. Will of course depend on the data model in your data warehouse but works well for us.