5 ms·

I'm fairly certain most of Reddit's server problems came from database R/W operations. If you look at some of the metrics they've put out recently you'll see th

I'm fairly certain most of Reddit's server problems came from database R/W operations. If you look at some of the metrics they've put out recently you'll see things like "queued upvotes/comments/messages" suggesting that they now heavily queue them. They also cache SUPER aggressively, very noticeable on large threads like those for sporting events where you can refresh a page and not see any updates for several minutes. I think this is a talent problem and not a "throw servers at it" problem. EDIT: As much as I like bashing Reddit I feel like I need to mention something. Reddit is the UNDISPUTED best news source for large, breaking, news stories. Reddit's live threads are curated and crowd sourced feeds containing information from police scanners, News outlets, twitter feeds, and a variety of other sources. It's value is in its ability to display conflicting information instantly such that the viewer can get the clearest picture possible. This thread of today's Dallas shooting is a prime example [1]. [1]: https://www.reddit.com/live/x7xfgo3k9jp7 https://www.reddit.com/live/x7xfgo3k9jp7

rangibaby 10y ago
Reddit also gets it wrong. They blamed a completely unrelated person (who had killed himself) for the Boston bombing, which is now a meme ("We did it Reddit!"), and even today a photo of a black man in army camo and holding an M16 was falsely claimed to be a shooter.
- ben_jones 10y ago
  Absolutely it can be dangerous, such as the use of police scanners (which will often broadcast uncorroborated information).
- eterm 10y ago
  That photo today was published by the Dallas PD, it wasn't a reddit thing. https://twitter.com/DallasPD/status/751262719584575488/photo/1 https://twitter.com/DallasPD/status/751262719584575488/photo... Besides, you're mixing up reddit the platform/company and reddit the commentariat.
  - fennecfoxen 10y ago
    > mixing up reddit the platform/company and reddit the commentariat The sane way to use Reddit is to log in, unsubscribe from everything that's by default, and add only things you are very interested in. Also go into your Settings and turn off all the suggested subreddits (and the outbound click tracking, surely). Do that, and you can browse your niche technology news and computer game and magical-girl-anime subreddits in peace -- otherwise it's just a losing fight against clickbait popularity contests and flash mobs for justice.
    - Noseshine 10y ago
      And do subscribe to /r/cats to get your daily dose of cat. http://i.imgur.com/f1yeHVO.jpg http://i.imgur.com/f1yeHVO.jpg
- cocotino 10y ago
  Completely off-topic here
Noseshine 10y ago
> I think this is a talent problem and not a "throw servers at it" problem. I don't see the point of your reply, since it doesn't counter or even remotely relate to anything I wrote. It certainly wasn't about whether humans or machines are there limiting factor.
- bcraven 10y ago
  "doesn't... even remotely relate" You're both talking about servers and difficulties with them.
  - Noseshine 10y ago
    Yeah... if you use enough abstraction an apple is like an orange. I can't argue on that basis.
jedberg 10y ago
As one of those talent, I have to respectfully disagree. First of all, R/W to the database was solved pretty early on. We had queues many years ago for the writes and tons of read slaves for the reads. Also, the servers that serve comments and listings were not the same ones that took in votes and comments. It was most definitely a "throw servers at it" problem, with a few bottlenecks on caching that were solved as they came up. The biggest issue was that we didn't have the budget (both money and manpower) to deal with scaling a global transaction system, which is just plain hard. Reddit gets almost as much traffic as eBay, but eBay has thousands of engineers and Reddit doesn't even have 100. Back when I was there, the site worked well enough, there were only a few of us, and we spent about 50% of our time on spam and about 25% on community management. That didn't leave much time for scaling and performance. For context, we were serving a billion pages a month on a budget of $50K/mo. Today they are making great progress in scalability because they finally have the budget to hire the people to make it great.

rangibaby 10y ago

Reddit also gets it wrong. They blamed a completely unrelated person (who had killed himself) for the Boston bombing, which is now a meme ("We did it Reddit!"), and even today a photo of a black man in army camo and holding an M16 was falsely claimed to be a shooter.

ben_jones 10y ago
Absolutely it can be dangerous, such as the use of police scanners (which will often broadcast uncorroborated information).
eterm 10y ago
That photo today was published by the Dallas PD, it wasn't a reddit thing. https://twitter.com/DallasPD/status/751262719584575488/photo/1 https://twitter.com/DallasPD/status/751262719584575488/photo... Besides, you're mixing up reddit the platform/company and reddit the commentariat.
- fennecfoxen 10y ago
  > mixing up reddit the platform/company and reddit the commentariat The sane way to use Reddit is to log in, unsubscribe from everything that's by default, and add only things you are very interested in. Also go into your Settings and turn off all the suggested subreddits (and the outbound click tracking, surely). Do that, and you can browse your niche technology news and computer game and magical-girl-anime subreddits in peace -- otherwise it's just a losing fight against clickbait popularity contests and flash mobs for justice.
  - Noseshine 10y ago
    And do subscribe to /r/cats to get your daily dose of cat. http://i.imgur.com/f1yeHVO.jpg http://i.imgur.com/f1yeHVO.jpg
cocotino 10y ago
Completely off-topic here

Noseshine 10y ago

> I think this is a talent problem and not a "throw servers at it" problem. I don't see the point of your reply, since it doesn't counter or even remotely relate to anything I wrote. It certainly wasn't about whether humans or machines are there limiting factor.

bcraven 10y ago
"doesn't... even remotely relate" You're both talking about servers and difficulties with them.
- Noseshine 10y ago
  Yeah... if you use enough abstraction an apple is like an orange. I can't argue on that basis.

jedberg 10y ago

As one of those talent, I have to respectfully disagree. First of all, R/W to the database was solved pretty early on. We had queues many years ago for the writes and tons of read slaves for the reads. Also, the servers that serve comments and listings were not the same ones that took in votes and comments. It was most definitely a "throw servers at it" problem, with a few bottlenecks on caching that were solved as they came up. The biggest issue was that we didn't have the budget (both money and manpower) to deal with scaling a global transaction system, which is just plain hard. Reddit gets almost as much traffic as eBay, but eBay has thousands of engineers and Reddit doesn't even have 100. Back when I was there, the site worked well enough, there were only a few of us, and we spent about 50% of our time on spam and about 25% on community management. That didn't leave much time for scaling and performance. For context, we were serving a billion pages a month on a budget of $50K/mo. Today they are making great progress in scalability because they finally have the budget to hire the people to make it great.