4 ms·

Agreed, great write-up. Anyone have other recommended links to write-ups about specific challenges and how to make them scale?

rajathagasthya 10y ago
I really like the "Big Data in Real-Time at Twitter" slides at https://www.slideshare.net/nkallen/q-con-3770885 https://www.slideshare.net/nkallen/q-con-3770885. They explain their original implementation and why it didn't scale, possible new implementations and their current one (it's a bit old though). It's clear and easy to understand.
josephg 10y ago
http://highscalability.com/ http://highscalability.com/ frequently features content like this. The archives are a treasure trove of practical software architecture wisdom.
petercooper 10y ago
Here are some recent ones that have been popular: http://highscalability.com/blog/2016/4/20/how-twitter-handles-3000-images-per-second.html http://highscalability.com/blog/2016/4/20/how-twitter-handle... https://redditblog.com/2017/1/17/caching-at-reddit/ https://redditblog.com/2017/1/17/caching-at-reddit/ https://blog.twitter.com/2017/the-infrastructure-behind-twitter-scale https://blog.twitter.com/2017/the-infrastructure-behind-twit... https://www.netlify.com/blog/2017/03/16/smashing-magazine-just-got-10x-faster/ https://www.netlify.com/blog/2017/03/16/smashing-magazine-ju... https://nickcraver.com/blog/2016/02/03/stack-overflow-a-technical-deconstruction/ https://nickcraver.com/blog/2016/02/03/stack-overflow-a-tech... https://engineering.linkedin.com/blog/2016/10/instant-messaging-at-linkedin--scaling-to-hundreds-of-thousands- https://engineering.linkedin.com/blog/2016/10/instant-messag... http://techblog.netflix.com/2016/08/building-fastcom.html http://techblog.netflix.com/2016/08/building-fastcom.html http://highscalability.com/blog/2016/9/28/how-uber-manages-a-million-writes-per-second-using-mesos-and.html http://highscalability.com/blog/2016/9/28/how-uber-manages-a... Or a recent writeup on a challenge building IMDB's forums in 2001(!) https://www.beatworm.co.uk/blog/internet/imdb-boards-no-more https://www.beatworm.co.uk/blog/internet/imdb-boards-no-more .. fun and scary in equal measures. (I'm plucking these from things were popular recently in our http://webopsweekly.com/ http://webopsweekly.com/ :-))

rajathagasthya 10y ago

I really like the "Big Data in Real-Time at Twitter" slides at https://www.slideshare.net/nkallen/q-con-3770885 https://www.slideshare.net/nkallen/q-con-3770885. They explain their original implementation and why it didn't scale, possible new implementations and their current one (it's a bit old though). It's clear and easy to understand.

josephg 10y ago

http://highscalability.com/ http://highscalability.com/ frequently features content like this. The archives are a treasure trove of practical software architecture wisdom.

petercooper 10y ago

Here are some recent ones that have been popular: http://highscalability.com/blog/2016/4/20/how-twitter-handles-3000-images-per-second.html http://highscalability.com/blog/2016/4/20/how-twitter-handle... https://redditblog.com/2017/1/17/caching-at-reddit/ https://redditblog.com/2017/1/17/caching-at-reddit/ https://blog.twitter.com/2017/the-infrastructure-behind-twitter-scale https://blog.twitter.com/2017/the-infrastructure-behind-twit... https://www.netlify.com/blog/2017/03/16/smashing-magazine-just-got-10x-faster/ https://www.netlify.com/blog/2017/03/16/smashing-magazine-ju... https://nickcraver.com/blog/2016/02/03/stack-overflow-a-technical-deconstruction/ https://nickcraver.com/blog/2016/02/03/stack-overflow-a-tech... https://engineering.linkedin.com/blog/2016/10/instant-messaging-at-linkedin--scaling-to-hundreds-of-thousands- https://engineering.linkedin.com/blog/2016/10/instant-messag... http://techblog.netflix.com/2016/08/building-fastcom.html http://techblog.netflix.com/2016/08/building-fastcom.html http://highscalability.com/blog/2016/9/28/how-uber-manages-a-million-writes-per-second-using-mesos-and.html http://highscalability.com/blog/2016/9/28/how-uber-manages-a... Or a recent writeup on a challenge building IMDB's forums in 2001(!) https://www.beatworm.co.uk/blog/internet/imdb-boards-no-more https://www.beatworm.co.uk/blog/internet/imdb-boards-no-more .. fun and scary in equal measures. (I'm plucking these from things were popular recently in our http://webopsweekly.com/ http://webopsweekly.com/ :-))