4 ms·
I ran a cluster of ~30k blade based computers booting entirely off iPXE. They didn't have any onboard ssd/disk storage or ECC memory. Every day, a few of them w
by latchkey 4y ago
I ran a cluster of ~30k blade based computers booting entirely off iPXE. They didn't have any onboard ssd/disk storage or ECC memory. Every day, a few of them would randomly lock up, they'd reboot with a fresh network image and keep on humming.
- yjftsjthsd-h 4y ago> Every day, a few of them would randomly lock up, they'd reboot with a fresh network image and keep on humming. There same ones, or random new machines every time?
- latchkey 4y agoTotally random.
- throwawaylinux 4y agoCould easily be software or some other marginal hardware bug though.
- latchkey 4y agoIndeed. Although, sometimes the machine wouldn't fully crash. It was like the disk was corrupted, but apps were still running, which makes me suspect it was the lack of ECC.
- jwiz 4y agoHow do you even get that many computers without ECC? I think all the blades I've seen have ECC as baseline spec.
- latchkey 4y agoThey were purpose built and didn't require 100% uptime.
- undersuit 4y agoGoogle started with "standard PCs", though I'm not finding any info if they used ECC memory. https://blog.codinghorror.com/building-a-computer-the-google-way/ https://blog.codinghorror.com/building-a-computer-the-google... https://patents.google.com/patent/US6549988 https://patents.google.com/patent/US6549988