3 ms·
databricks is not only database. spark is not only for analytics. spark is distributed and fast runtime for applications. it can be a platform powering the ent
by slt2021 4y ago
databricks is not only database. spark is not only for analytics.
spark is distributed and fast runtime for applications. it can be a platform powering the entire company/startup and its backend data pipeline.
rdbms like postgres cannot compete, because sql is about storage and querying (you need application code to do complex processing) and sql is hard to scale (unless you want to shard your db into million pieces and have ways to manipulate millions of db shards).
also - how good luck shuffling data between thousands of rdbms shards, if you believe rdbms can replace spark.
the problem with databricks is that their offering is not differentiated enough from opensource spark. So their only value add is "we will manage your managed spark cluster, pls pay us, instead of your Ops/IT team?"