2 ms·
this is the key question. you have to build for your peak access rate. Also, are you replacing an existing service with a known traffic pattern? If not, how
by grandalf 18y ago
this is the key question. you have to build for your peak access rate.
Also, are you replacing an existing service with a known traffic pattern? If not, how are you coming up with your estimate?
Is there any way you can dial back the service a bit if load exceeds capacity -- maybe scheduling the cron jobs for every hour instead of 15 mins? If so then you might want to start with a smaller number of servers and provision additional ones as you are sure of the load.
Also, why not use ec2, slicehost, or some approach that lets you grow (or shrink) your infrastructure as needed?
- adserverboy 18y agothanks grandalf. We are consolidating a number or services from different departments into one single access point. We are also open to using ec2. The question on my mind is how do I estimate how many ec2 (small or large instance) servers (and consequently the budget) we need to support the expected traffic.
- grandalf 18y agoWell, with ec2 you can fire up an instance for a few hours and do some load testing. I recommend creating a load test with characteristics that mimic what you think you'll see in production and then just run apachebench or httperf from another ec2 instance. You might even want to include in your code some calls to sleep or some slow loops, or even some code to create more frequent cache misses, all of this might help you generate a more conservative estimate. These are just a few ideas. I think you could probably come up with a reasonable guess at costs this way, all for a few hours of ec2 time. A lot depends on your load and how memory vs cpu vs IO intensive it is, and it will all impact which sort of load balancing you end up deciding to use. I suppose even if you don't end up going with ec2 it would still provide some useful benchmark results.
- adserverboy 18y agothanks grandalf. I'll give it a go. Also found this site - http://highscalability.com/ http://highscalability.com/ Very good resource.