3 ms·
Their moat is their phenomenal sales team. Like, I'm at company 3 that pays for databricks. Amount of those companies that use Spark = 0. I've given up compl
by disgruntledphd2 3y ago
Their moat is their phenomenal sales team.
Like, I'm at company 3 that pays for databricks.
Amount of those companies that use Spark = 0.
I've given up complaining now.
- esafak 3y agoSo what are they using, the notebooks?
- pletnes 3y agoBut in the notebooks you run pyspark / scala spark / spark sql code?
- esafak 3y agoYes, you can, if you want.
- disgruntledphd2 3y agoYes, but for most of these companies they don't actually run (much or any) spark stuff, they just use the notebooks. It's really depressing, tbh but I've made my peace with it now.
- pletnes 3y agoI can’t blame them really. Regular pandas-in-notebook can deal with quite a bit of data and is reasonably convenient. Even if the org and datasets are large, it’s rare to have huge single tables. Then you can go full spark when you have to.
- disgruntledphd2 3y agoSure, but why bother paying databricks for that? By default you'll be running 3+ machines while doing all your work in memory on the master node. It's just so very, very silly.
- pletnes 3y agoTrue. I’ve been wondering why they don’t facilitate non-spark use better. But then you can’t reasonably invoice 3 VMs extra, obviously.
- deleted 3y ago[deleted]