7 ms·
I think the optimal point is more ambiguous in the industry than we normally think. In the earlier part of the teens SaaS businesses in high throughput (>1k TP
by lumost 6y ago
I think the optimal point is more ambiguous in the industry than we normally think. In the earlier part of the teens SaaS businesses in high throughput (>1k TPS) fields such as ad-tech were often created with ruby/python and related languages. From my observation these businesses hit significant friction managing costs as they scaled relative to peer companies using Java/C stacks. While it was possible to build a competing product on latency, it wasn't generally feasible to build a competing product on latency and cost given the throughput constraints. Particularly while maintaining adequate feature velocity. When I worked in such shops cost was a constant conversation during development ( for good reason ) and that conversation didn't come up nearly as often in the statically typed shops. Everyone thought they were more productive in Ruby/Python at the time.
The gap between python and java is a lot bigger than java and C though, and I wouldn't be surprised if the latter optimization doesn't become worth it for a while longer.