3 ms·
> Until then if you wanted something to go faster you simply bought a bigger computer. People were not stupid back then, you know. MR did not introduce horizon
by Hendrikto 3y ago
> Until then if you wanted something to go faster you simply bought a bigger computer.
People were not stupid back then, you know. MR did not introduce horizontal scaling.
- srj 3y agoThis was not my first programming job and I didn't mean to imply stupidity. Maybe you could give some examples? I had seen it in some contexts: distcc, networking, seti@home. At least to me it didn't seem as common a tactic as trying to scale up the hardware on the machine or designing a different algorithm. That's generally what I saw at Microsoft in the years before. Maybe it was more the power of combining it with a "cloud" and containers - being able to change just the value of --mapreduce_machines= to something like 10000 and seeing it happen. That's the first time I had been exposed to that.