3 ms·
He's talking about writing it for Apache Spark. Which really isn't intended for 100 MB (I bet I could write a unix pipe & filter script that's faster than Spar
by parasubvert 11y ago
He's talking about writing it for Apache Spark.
Which really isn't intended for 100 MB (I bet I could write a unix pipe & filter script that's faster than Spark), but is intended for 10 TB through several PB.