4 ms·
To put that in perspective, if you assume a token is 4 bytes, that’s about 164 MB/s of traffic, which sounds a bit less staggering.
by plaidfuji 5mo ago
To put that in perspective, if you assume a token is 4 bytes, that’s about 164 MB/s of traffic, which sounds a bit less staggering.
- dnnddidiej 5mo agoDealing with a lot of traffic for a small team isn't hard in itself. If it is easy to parallelise you just need to horizontally scale. And most concerns can be added as sidecars or middleware. Rate limits, auth, etc. Basically this is a kubernetes cluster. For a 3 person startup hard. For 50 pretty managable.
- 0x6c6f6c 4mo agoAnd if you were a smaller team then you don't even need K8s. Just ECS or Cloud Run have simple abstractions for horizontally scalable services and sidecars support.