3 ms·
To be fair "one huge spike" is not as big of a load as a lot of internet services How big is a tax return? Some XML 10k/100k in size? What do you need to do:
by raverbashing 9y ago
To be fair "one huge spike" is not as big of a load as a lot of internet services
How big is a tax return? Some XML 10k/100k in size?
What do you need to do: save the file, maybe do some basic sanity checking and store the SSN of a person on a db.
It is complicated, but not impossible.
- vorpalhex 9y agoBut, you're going from maybe 10k * X requests a day, to several million. Any system is vulnerable in that kind of very aggressive scaling situation - see every single game launch with a multiplayer component since the dawn of time. Obviously you can scale systems ahead of time if you know, but you still run into issues because you probably haven't scaled the entire system and don't know the likely bottlenecks since it's hard to generate that kind of traffic in a QA environment. Think of the scale of facebook, and then realize most of their payloads are <1k json/protobuf. It's not the size of the payload, it's the delta in quantity.
- khedoros1 9y agoBut they also know roughly when the load is going to hit, and how many requests they'll receive. It's not a one-time event like a game launch. They've also been using the same system for decades and ought to be pretty familiar with the various bottlenecks.
- billhendricksjr 9y agoMeF (“Modern” eFile) is only 5ish years old. The earlier version was EDI based I believe.