Here is my advice having struggled with scalability for the last two years, please take with a grain of salt... Regarding the previous discussion of EC2 etc - E

Here is my advice having struggled with scalability for the last two years, please take with a grain of salt... Regarding the previous discussion of EC2 etc - EC2 just gives you headless linux boxes that you can do with as you please. You have to configure the disks specially to gain persistence of data or use S3 or SimpleDB. There is a lot of background knowledge of linux that is going on. For scalability, I would first concentrate on the engineering quality of your codebase. Get lots of tests and get them running nightly and automatically. Automation of tasks is your friend, so if you don't already know ant spend the 2 days it takes to learn it. To really scale well, you are going to need a cluster of machines - this means your app is going to be running in multiple address spaces so you will need to handle that issue - if you haven't already done so, look up memcached. I think you should focus on stability first, make sure your app can run "forever" - the two big blockers to you there are memory usage and concurrency issues. Memory usage means cleaning up after yourself and avoiding memory leaks, instrumentation and a profiler are your friends here. For concurrent issues, you should do a thorough study of thread management and make sure your locks are consistent. Once you have all these stability issues under control, I think it is about having good interfaces for key components of your code, identifying bottlenecks in performance (again, instrumentaiton) and then rewriting these bottlenecks. There is also the issue of making sure that you are transmitting the minimum amount of data required and strategies for scaling up. If you are doing work for the Navy, be prepared for fairly serious scrutiny of your security practices as well - security, like scalability, it much harder to tack on later. Last but not least, remember that premature optimization will kill your time.