3 ms·
Well, big data for me was always clear -- when data sizes are too large to use regular tools (ls, du, wc, vi, pandas). I.e. when pretty much every tool or scri
by deepsun 2y ago
Well, big data for me was always clear -- when data sizes are too large to use regular tools (ls, du, wc, vi, pandas).
I.e. when pretty much every tool or script I used before doesn't work anymore, and need a special tool (gsutil, bq, dusk, slurm), it's a mind shift.