4 ms·
In theory sure in practice I beg to differ. You tend to end up writing different levels of annoyingly intricate spark code as your data volume, processing comol
by ramraj07 3y ago
In theory sure in practice I beg to differ. You tend to end up writing different levels of annoyingly intricate spark code as your data volume, processing comolexity (and infra constraints) increase.
Anyone who says this is not true hasn't tried to join two 10 TB dataframes on a highly skewed key with a hundred million unique values without spending thousands of dollars and without failing at random instances.