4 ms·
Found a single line of byte code that cost $4M of compute per year.
by calmtech 4y ago
Found a single line of byte code that cost $4M of compute per year.
- suprjami 4y agoPlease tell us more. This sounds like a good investigative story.
- TruthWillHurt 4y agosleep(3)
- calmtech 4y agoWe noticed that one line of byte code was crazy hot. We traced it back to the code, and realized it was a special case fallback. They were summing 10mb of 8 bit encoded integers, in the 99.5th percentile of traffic, so no one noticed. It was using 10% of fleet compute. We changed the encoding to 64bit; the data size stayed constant, the 99.5%tile latency plummeted, and I got a bonus. Took a week. My contribution to climate change. A lot of stuff can hide past 99%.
- suprjami 4y agoThat's awesome!