5 ms·
I think it's laughable to put Twitter and Digg in the same category of scalability as Facebook. Maybe things have changed since the last time I visited Digg ov
by dasil003 17y ago
I think it's laughable to put Twitter and Digg in the same category of scalability as Facebook.
Maybe things have changed since the last time I visited Digg over 2 years ago, but the social networking aspects are not very significant. The vast majority of their hits are practically fully page cacheable.
Twitter at least has an interesting scaling problem, but they don't have any features and they move at a glacial pace.
Facebook on the other hand has a graph that almost as nasty as Twitter's (minus the million followers thing), but they have 100 times the features, and they push new code every week.
- timf 17y agoFacebook also "has about 30,000 servers supporting its operations, hosts 80 billion photos, and serves up more than 600,000 photos to its users every second." (check out http://www.facebook.com/Engineering?v=wall http://www.facebook.com/Engineering?v=wall )
- yarapavan 17y agoFacebook handles 30K machines, 300M active users, 20B photos, & 25TB per day of logging data. http://bit.ly/EA3oY http://bit.ly/EA3oY
- deleted 17y ago[deleted]
- joe_the_user 17y agoWhat makes Twitter hard is that it is a semi-real-time communications medium that is no longer particularly web-based - a good portion of Tweets come from phones. But you're right with Digg, I don't see it having any excuses
- deleted 17y ago[deleted]
- ivankirigin 17y agoThere are facebook pages with millions of fans. If you fan a page, you'll "subscribe" its updates too. It is similar to asymmetric following. The internal representation is quite elegant.
- jdrock 17y agoFB should be more difficult as well because they aren't just showing streaming information. They're making (supposedly) intelligent decisions on what information to show you. Twitter is just showing you a "dumb" stream.
- litewulf 17y agoAt the same time, facebook can simply drop messages on the floor if they're bottlenecked, so they have less strict scaling requirements.
- gaius 17y agoTwitter has guaranteed delivery? Are you sure? The killer app of Facebook - poking - does need to be reliable ;-)
- litewulf 17y agoI'm pretty sure Twitter is "guaranteed delivery", but thats just my naive user expectation. Poking, while needing to be reliable is a 1:1 activity, so light on writes and easy to read, whereas broadcasting is difficult because of the wide variance in update frequency and number of followers from user to user.
- mikeryan 17y agoJust because Twitter and Digg don't operate at the same scale as Facebook doesn't mean they don't face similar issues. I actually think having a bunch of large sites tackling similar issues will present a whole bunch of neat new technologies for addressing these sorts of issues in the near future.
- dasil003 17y agoI'm not talking about absolute scale. Facebook is small compared to Google scale, but in my (probably poorly) informed opinion it's not as impressive. All these sites have scaled to multiple servers, which means they've all had to address some of the hard problems, and no doubt that many of the issues are very similar. However even if Facebook's traffic were half of Twitter's it would still be a much more impressive architecture. They support a full-on integrated development platform for crying out loud. That is orders of magnitude more impressive than Twitter's lightweight API whether they're serving 100 or 100,000 requests per second. I'm not dissing Twitter either, it's just that what Facebook has going is pretty incredible. Consider that failing to scale is basically what killed Friendster.
- mikeryan 17y agoI understand what you're saying Facebook is massively complex compared to digg and twitter - which is likely why it chews up the majority of the article. But I'm not sure why you can't have a top level discussion about scaling (which seems to be the point of the article) that is relevant to all three.
- dasil003 17y agookay fair point.
- pavs 17y ago"However even if Facebook's traffic were half of Twitter's" Huh?
- 17y ago
- rythie 17y agoActually I've found that people follow twice as many people on Twitter as on Facebook and receive updates a whole load more often. Facebook does benefit from being a older company with a lot more engineers though.
- yariv 17y agoWe (FB) actually push new code every day.