3 ms·
People make the mistake of thinking it's a single 100GB dataset. When it's more common to be manipulating lots of smaller datasets together in a way where you
by threeseed 2y ago
People make the mistake of thinking it's a single 100GB dataset.
When it's more common to be manipulating lots of smaller datasets together in a way where you need to have more than 100GB of disk space. And in this situation you really need Spark.