3 ms·
How much memory would a spark worker need to process a single JSON file that is 25GB? To clarify, this is not JSONL or NDJSON file. Just a single JSON object.
by iknownothow 4y ago
How much memory would a spark worker need to process a single JSON file that is 25GB?
To clarify, this is not JSONL or NDJSON file. Just a single JSON object.