6 ms·
Airbnb Tech Talk: Jeremy Edberg of reddit and Netflix -- Building with Clouds
- Evbn 14y agoSince Reddit has been down a lot today... awkward.
- jedberg 14y agoI've had nothing to do with reddit's operations for about 16 months now. I didn't even know it was down today. :)
- redthrowaway 14y agoAlso, it's been down way less since you left. Coincidence, or vastly increased budget and staffing? We give you the facts, you decide at 6.
- jedberg 14y agoHave I wronged you in the past? I ask because pretty much every time there is a thread about reddit or Netflix tech that I comment on, there you are slinging insults at me (which are incorrect, BTW). I'd love to know what I did to harm you so that I can apologize. Or do you just like giving me a hard time for the lulz?
- danilocampos 14y agoI've noted redthrowaway to be oddly but harmlessly enraptured by morsels of Reddit inside baseball[1]. You may be mistaking affectionate ribbing for spite. Or maybe I'm missing someone's dickishness, who knows. 1. An exemplary specimen from this very thread: http://news.ycombinator.com/item?id=4681972 http://news.ycombinator.com/item?id=4681972
- redthrowaway 14y agoThat's pretty much the gist of it, yup.
- redthrowaway 14y agoThat wasn't intended as an insult in the slightest, and I apologize if it came off as such. It was meant to be a light-hearted joke. I also don't recall any other threads where I may have given you that impression, but apologize (again) if I have. To clarify, I'm a long-time redditor who was pretty impressed with how well you guys managed given the small team you had.
- jedberg 14y agoAh, alright then. Looks like danilocampos was right. My mistake! :)
- jedberg 14y agoI know I referred to myself in the third person, but it was easier than expecting people to look at the username. :) Also, if you're attending or watching at home and there is something specific you're hoping I will cover, tell me here in the comments and I'll do my best to cover it!
- ojilles 14y agoJust remember, 75% of the folks here on hacker news won't be attending your event, so following up with the slides/video would be much appreciated and would go a long way of increasing your reach!
- kill-9-1 14y agoIf 25% of hacker news folks attend, then the talk will have about 100,000 people. Jeremy - you better get a whole football field for your talk!
- adambrod 14y agoIf you're ever in the area make sure you attend! Airbnb puts on a great evening... beer, food, and tech BS'ing. Doesn't get any better!
- nandemo 14y agoHonestly, I think your username is more recognizable than your name. I "know" who jedberg is but until I saw this post I didn't know your name was Jeremy.
- jedberg 14y agoIt's funny, I was going to put my username in the title, but that just seemed a little too ... much.
- codewright 14y agoDid Reddit overcome its rather serious persistence-side issues? It seemed like the object-blob Postgres store was a disaster, then they brought in Cassandra which was initially used as a cache of sorts, but now is the primary point of contact for threads apparently? Reverse-engineering the persistence strategy from the open sourced code is more tedious and potentially inaccurate than I am comfortable with, so could a Reddit employee or code contributor provide some insight as to how those problems were worked past? There was Reddit downtime today (read-only mode), which is common. What's the usual cause of that sort of thing these days?
- jedberg 14y agoI can cover the rest in the talk, but I just want to comment that the Postgres object-blob store (as you describe it :) ) was not only NOT a disaster, but one of the strongest parts of the persistence layer.
- codewright 14y agoThen where did the growth pains that necessitated Cassandra come from? I'm trying to build up a mental genealogy of the engineering decisions made so that the knowledge isn't lost to future programmers. Most of you OG peeps have moved onto greener pastures.
- keysersosa 14y agoketralnis will likely remember this better, but by my recollection we switched to cassandra after we hit the limit of what we could do with memcachedb: http://blog.reddit.com/2010/01/why-did-we-take-reddit-down-for-71.html http://blog.reddit.com/2010/01/why-did-we-take-reddit-down-f... We were already using memcachedb as a persistent keystore, "caching" precomputed listings and comment threads. When it started becoming more trouble than it was worth to maintain, we decided to try cassandra as a beefier replacement.
- ketralnis 14y ago
- antonID 14y agoDang, all sold out. Got on the wait list, hopefully I'll be able to snag a spot.