3 ms·
Agree 100%. A 96 vCPU box with > 200 GB of RAM is ~$1.55/hour with an EC2 Spot instance. Back that with a big SSD and you have a data processing monster. Use y
by DLA 7y ago
Agree 100%.
A 96 vCPU box with > 200 GB of RAM is ~$1.55/hour with an EC2 Spot instance. Back that with a big SSD and you have a data processing monster. Use you some nice Golang with well-formed goroutines to leverage all those cores and a damn good many data processing tasks could be crushed on a single box for sure.
Metaphorically: Every gear you add to a machine (distributed this and that) is a gear that needs to be cared for (configured, managed) and could break the overall machine.
Simpler is better.
- zomglings 7y agoMy favorite recent infrastructure tool is Ansible. Really makes it easy to set those boxes up and derive full utility from them. Don't know if I hang around the wrong circles, but Ansible doesn't seem to get much love.