3 ms·
> Posts are about 50GB a day. Follower list updates are about 2.7TB a day. Holy schnikeys! The graph changes are two orders of magnitude larger than the conte
by feralchimp 15y ago
> Posts are about 50GB a day. Follower list updates are about 2.7TB a day.
Holy schnikeys! The graph changes are two orders of magnitude larger than the content additions.
- thesethings 15y agoThat caught my eye too, and I guessed on Twitter that it might be a typo/under-explained. Somebody from Tumblr (though on a different team) was nice enough to respond and guessed that it was because all media on S3 was not counted. https://twitter.com/#!/adamlaiacano/status/169140791732740096 https://twitter.com/#!/adamlaiacano/status/16914079173274009...
- mcherm 15y agoThanks. It seemed completely unreasonable to me until I saw this explanation.
- harryh 15y agoThis was very surprising to me as well. Assuming that IDs are 8 bytes (they appear to be) and that the mean post is 250 bytes (which seems conservative to me) then the mean fanout is something like 1600. That's big.