Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
InjectionVE
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
InjectionVE
5y ago
At work we are batch-processing a decent amount of data every night using Spark. The way the workload can be split into parts allows the following strategy: - Generate jobs only containing metadata and distribute those jobs to workers. Ther