3 ms·
That doesn’t sound right… maybe per user?
by booi 3y ago
That doesn’t sound right… maybe per user?
- eddtries 3y ago1 Trillion function calls over 100,000 servers. Technically they say trillions over hundreds of thousands, but I went for the lower case. 1,000,000,000,000 / 100,000 = 10,000,000 10,000,000 / 24 / 3600 = 115.7
- xxs 3y agoWe don't know what the servers are; dual socket EPIC, i.e. 128cores, makes the number look beyond trivial.
- kunley 3y agoSo... 115.7 rps doesn't sound groundbreaking, right?
- eddtries 3y agoWas just trying to break the number down to something more easy to understand, I don’t know enough if this is impressive or not! Depends on the complexity of the request, and I guess the complexity of routing that many requests over such a large network. I’ve never worked at that scale.
- nick0garvey 3y agoThis isn't unreasonable. ML workloads benefit from more computational time per request. Lower QPS = better results.