4 ms·

Latency is Everywhere and it Costs You Sales - How to Crush it

28 points by paulsb 17y ago

iheartmemcache 17y ago
Some of these tips are really good (using a CDN, caching on basically every layer, using YSlow), but does the author really believe using FPGAs and ASICs for websites is really practical? I've yet to see one real-world report of people using FPGAs to speed up sites. Hell, I haven't even seen any academic proof of concepts focusing on the merits of FPGAs in the web environment. That's not to say that FPGA's won't be useful (they could potentially be helpful for real-time ranking and the like), it just seems out of character to mention something like that on a website scalability site. Grain of salt, and all that.
- agnokapathetic 17y ago
  It is overkill, but dedicated special purpose hardware like a hardware SSL Accelerator (http://en.wikipedia.org/wiki/SSL_acceleration http://en.wikipedia.org/wiki/SSL_acceleration) is certainly useful, and its not unfathomable that one of these would use an FPGA.
- olefoo 17y ago
  I think it's the web nerds equivalent of mechanics talking about Formula 1 race cars, most people who are in the field will never even be closing to needing that level of technology, but when you do you really do. If you are doing lots of ssl connections some form of accelerator, whether drop in cards or a standalone box, are well worth the cost.
- smithjchris 17y ago
  FPGAs are impractical. They are designed for integration and custom design rather than performance. Any data processing tasks are probably not worth it. Intel i7 series CPUs are probably a better investment as they have native text-processing instructions!
  - Andys 17y ago
    I just found a benchmark on Intel's site that shows the effect of enabling the text processing instructions in SSE4.2. They claim a 25% speedup for XML parsing and 37% for XML validating.
daleharvey 17y ago
I think this quote should have been a headline as opposed to an easily missable list item '80-90% of the end-user response time is spent on the frontend, so it makes sense to concentrate efforts there before heroically rewriting the backend.'
- jules 17y ago
  What is done in that 80-90%, and how do you optimize it?
  - patio11 17y ago
    Watch the YSlow guys and be enlightened. Everything they produce about the subject (and I don't just mean the plugin) is solid gold. They are easily the best "Follow these simple directions and you will make money" technical material I've ever seen. video of talk: http://www.youtube.com/watch?v=BTHvs3V8DBA http://www.youtube.com/watch?v=BTHvs3V8DBA slides of another: http://www.slideshare.net/stoyan/high-performance-web-pages-20-new-best-practices http://www.slideshare.net/stoyan/high-performance-web-pages-...
    - daleharvey 17y ago
      sorry way away, yeh the yslow stuff is really good, the new google tool is also handy although not particularly different. http://developer.yahoo.com/yui/theater/ http://developer.yahoo.com/yui/theater/ - also has a series of good website performance videos
  - mattyb 17y ago
    Get the two Souders (creator of YSlow, now works on web performance at Google) books, which are amazing. I'm not affiliated with Amazon.com, O'Reilly or Yahoo!; just like Patrick says, these guys know their shit: High Performance Web Sites (O'Reilly, Sept. 2007): http://www.amazon.com/High-Performance-Web-Sites-Essential/dp/0596529309/ref=sr_1_1?ie=UTF8&qid=1248619916&sr=8-1 http://www.amazon.com/High-Performance-Web-Sites-Essential/d... Even Faster Web Sites (O'Reilly, June 2009): http://www.amazon.com/Even-Faster-Web-Sites-Performance/dp/0596522304/ref=sr_1_3?ie=UTF8&qid=1248619916&sr=8-3 http://www.amazon.com/Even-Faster-Web-Sites-Performance/dp/0... Half of King's 'Website Optimization: Speed, Search Engine & Conversion Rate Secrets' (O'Reilly, July 2008) is devoted to performance, so it's also worth a look: http://www.amazon.com/Website-Optimization-Search-Conversion-Secrets/dp/0596515081/ref=sr_1_2?ie=UTF8&qid=1248619916&sr=8-2 http://www.amazon.com/Website-Optimization-Search-Conversion...
mistermann 17y ago
A bit off topic, but could someone recommend any good articles or case studies highlighting the importance of site design and the potential affect on sales of nuanced site changes (ie: I recall reading an article about how a small change to a checkout process increased sales x%, but can't find that article). I am trying to put together some reading material for a non-technical person in my startup who is unconcerned that our web design company is botching things. (Even if you don't have a specific link, if you remember reading something and can remember the company name or an googleable information, it would be much appreciated).
- patio11 17y ago
  http://www.youtube.com/watch?v=erdEZvOq6wo http://www.youtube.com/watch?v=erdEZvOq6wo (Several examples where a single call to action was changed trivially, resulting in millions.) http://www.bingocardcreator.com/articles/developing-shopping-cart.htm http://www.bingocardcreator.com/articles/developing-shopping... (Rather less impressive ;) ) http://blog.pokercopilot.com/2008/10/do-big-shiny-download-buttons-work.html http://blog.pokercopilot.com/2008/10/do-big-shiny-download-b... (Answer: yes.)
  - mattyb 17y ago
    OT: Your article was damn good. Have you written any others (going up to /articles didn't work)?
    - patio11 17y ago
      Most of my articles are on my blog rather than my business site -- I only put them there when I need to use Rails to spit something out for the article. The blog is at http://www.kalzumeus.com http://www.kalzumeus.com .
Locke1689 17y ago
"Latency is physics, bandwidth is money."

28 points by paulsb 17y ago

Some of these tips are really good (using a CDN, caching on basically every layer, using YSlow), but does the author really believe using FPGAs and ASICs for websites is really practical? I've yet to see one real-world report of people using FPGAs to speed up sites. Hell, I haven't even seen any academic proof of concepts focusing on the merits of FPGAs in the web environment. That's not to say that FPGA's won't be useful (they could potentially be helpful for real-time ranking and the like), it just seems out of character to mention something like that on a website scalability site. Grain of salt, and all that.

agnokapathetic 17y ago
It is overkill, but dedicated special purpose hardware like a hardware SSL Accelerator (http://en.wikipedia.org/wiki/SSL_acceleration http://en.wikipedia.org/wiki/SSL_acceleration) is certainly useful, and its not unfathomable that one of these would use an FPGA.
olefoo 17y ago
I think it's the web nerds equivalent of mechanics talking about Formula 1 race cars, most people who are in the field will never even be closing to needing that level of technology, but when you do you really do. If you are doing lots of ssl connections some form of accelerator, whether drop in cards or a standalone box, are well worth the cost.
smithjchris 17y ago
FPGAs are impractical. They are designed for integration and custom design rather than performance. Any data processing tasks are probably not worth it. Intel i7 series CPUs are probably a better investment as they have native text-processing instructions!
- Andys 17y ago
  I just found a benchmark on Intel's site that shows the effect of enabling the text processing instructions in SSE4.2. They claim a 25% speedup for XML parsing and 37% for XML validating.

daleharvey 17y ago

I think this quote should have been a headline as opposed to an easily missable list item '80-90% of the end-user response time is spent on the frontend, so it makes sense to concentrate efforts there before heroically rewriting the backend.'

jules 17y ago
What is done in that 80-90%, and how do you optimize it?
- patio11 17y ago
  Watch the YSlow guys and be enlightened. Everything they produce about the subject (and I don't just mean the plugin) is solid gold. They are easily the best "Follow these simple directions and you will make money" technical material I've ever seen. video of talk: http://www.youtube.com/watch?v=BTHvs3V8DBA http://www.youtube.com/watch?v=BTHvs3V8DBA slides of another: http://www.slideshare.net/stoyan/high-performance-web-pages-20-new-best-practices http://www.slideshare.net/stoyan/high-performance-web-pages-...
  - daleharvey 17y ago
    sorry way away, yeh the yslow stuff is really good, the new google tool is also handy although not particularly different. http://developer.yahoo.com/yui/theater/ http://developer.yahoo.com/yui/theater/ - also has a series of good website performance videos
- mattyb 17y ago
  Get the two Souders (creator of YSlow, now works on web performance at Google) books, which are amazing. I'm not affiliated with Amazon.com, O'Reilly or Yahoo!; just like Patrick says, these guys know their shit: High Performance Web Sites (O'Reilly, Sept. 2007): http://www.amazon.com/High-Performance-Web-Sites-Essential/dp/0596529309/ref=sr_1_1?ie=UTF8&qid=1248619916&sr=8-1 http://www.amazon.com/High-Performance-Web-Sites-Essential/d... Even Faster Web Sites (O'Reilly, June 2009): http://www.amazon.com/Even-Faster-Web-Sites-Performance/dp/0596522304/ref=sr_1_3?ie=UTF8&qid=1248619916&sr=8-3 http://www.amazon.com/Even-Faster-Web-Sites-Performance/dp/0... Half of King's 'Website Optimization: Speed, Search Engine & Conversion Rate Secrets' (O'Reilly, July 2008) is devoted to performance, so it's also worth a look: http://www.amazon.com/Website-Optimization-Search-Conversion-Secrets/dp/0596515081/ref=sr_1_2?ie=UTF8&qid=1248619916&sr=8-2 http://www.amazon.com/Website-Optimization-Search-Conversion...

mistermann 17y ago

A bit off topic, but could someone recommend any good articles or case studies highlighting the importance of site design and the potential affect on sales of nuanced site changes (ie: I recall reading an article about how a small change to a checkout process increased sales x%, but can't find that article). I am trying to put together some reading material for a non-technical person in my startup who is unconcerned that our web design company is botching things. (Even if you don't have a specific link, if you remember reading something and can remember the company name or an googleable information, it would be much appreciated).

patio11 17y ago
http://www.youtube.com/watch?v=erdEZvOq6wo http://www.youtube.com/watch?v=erdEZvOq6wo (Several examples where a single call to action was changed trivially, resulting in millions.) http://www.bingocardcreator.com/articles/developing-shopping-cart.htm http://www.bingocardcreator.com/articles/developing-shopping... (Rather less impressive ;) ) http://blog.pokercopilot.com/2008/10/do-big-shiny-download-buttons-work.html http://blog.pokercopilot.com/2008/10/do-big-shiny-download-b... (Answer: yes.)
- mattyb 17y ago
  OT: Your article was damn good. Have you written any others (going up to /articles didn't work)?
  - patio11 17y ago
    Most of my articles are on my blog rather than my business site -- I only put them there when I need to use Rails to spit something out for the article. The blog is at http://www.kalzumeus.com http://www.kalzumeus.com .

Locke1689 17y ago

"Latency is physics, bandwidth is money."