Have you considered re-architecting to leverage the processing power of the client? Shifting where some of the computation takes place can help you get over so

Have you considered re-architecting to leverage the processing power of the client? Shifting where some of the computation takes place can help you get over some serious scaling problem. Case study from past experience: imagine a nested commenting system such as this. Imagine it with 10x the data and 20x the usage. By switching from building everything on the server and sending a massive html file, one could simply request a json file on load and then build the comments dynamically on the client. An architecture shift such as this would result in a serious improvement for network bandwidth, cpu, and ram.