3 ms·
Choosing an architectural design simply because it makes data warehousing easier doesn’t seem like a good enough reason to me. You give examples of all the Big
by pm90 7y ago
Choosing an architectural design simply because it makes data warehousing easier doesn’t seem like a good enough reason to me.
You give examples of all the Big Tech having such shared DBs but that seems like more of a reason to not use that pattern. Good DBAs are hard to find and not many people choose to become DBAs anymore. Big Tech can hire the experienced ones since they can compensate them pretty well; most companies can’t. The shared DB therefore becomes a critical bottleneck to the business.
- jeffffff 7y agobeyond some fairly large size of company it's less that it makes data warehousing easier and more that it makes centralized data warehousing possible. fortunately this type of environment is available today as a managed service in a few different offerings. gcp has spanner and vitess is available as a managed service on multiple cloud providers from planetscale.
- closeparen 7y agoCentralized data warehousing is possible as long as you constrain the number of distinct database engines and provide connectors for those. Services having private databases doesn't preclude data warehousing. It's why we have data warehousing! To enable joins across data from different silos.