9 ms·
Memory leaks detection paper co-authored by Netflix CEO Reed Hastings in 1992 [pdf]
- andsoitis 4y agoHastings co-founded Pure Software in 1991. Their products were for software troubleshooting. He co-founded Netflix in 1997. https://en.wikipedia.org/wiki/Reed_Hastings https://en.wikipedia.org/wiki/Reed_Hastings
- ww520 4y agoNo wonder Netflix has such a huge emphasis on engineering talent.
- gardenhedge 4y agoBut Netflix was originally DVD rental. At that time it wasn't a tech company was it?
- znkynz 4y agoDo you consider Amazon a tech company prior to AWS product launch?
- cjglo 4y agoIt was an online website right around the dot com bubble. It definitely was a tech company by that time’s standards. Nowadays every company has an online store, but that was not the case when Amazon was selling books online that you usually had to go to a store for.
- chx 4y ago> It was an online website right around the dot com bubble. Much sooner than that. Amazon started in 1995. Not a lot of ecommerce websites existed then. One the earlier ones is Powell's Books which started selling in 1993 via telnet, in 1994 via web.
- jm20 4y agoAmazon made web-based book selling mainstream. Emphasis on web. Of course it was a tech company.
- xwolfi 4y agoAnd the web based dvd rental then ? I mean, they were doing exactly the same as Amazon, why distinguish?
- gardenhedge 4y agoBanks have online customer sites. Are they tech companies?
- WastingMyTime89 4y agoIf they did it when Amazon started their web store they would be. How do you think Amazon infra gave birth to AWS? Does that sound to you like something a retail company would do?
- Throw10987 4y agoBanks are tech companies, the business leadership just don't know it.
- gpderetta 4y agoThe business leadership of some banks do in fact know it.
- version_five 4y agoTech company did and still does to an extent refer to "online" first, vs brick and mortar. In the context of the dot com boom, they were definitely tech
- jandrewrogers 4y agoNetflix was originally intended as a streaming company. The DVD rentals were a strategy to solve some non-technical problems with the business while the infrastructure for streaming caught up.
- gabcoh 4y agoThat's fascinating and an incredible example of long term planning. Do you have a source for this? edit: A very cursory check of the Wikipedia page and https://www.vox.com/2017/9/13/16288364/streampunks-book-excerpt-youtube-netflix-pivot-video https://www.vox.com/2017/9/13/16288364/streampunks-book-exce... suggest that it probably isn't true that Netflix was "originally intended as a streaming company" considering at it's founding online streaming was still far from feasible, but I'm open to evidence to the contrary.
- jandrewrogers 4y agoMy source is that I worked at Netflix in the early days, it was always part of the strategy. We were discussing streaming internally almost a decade before they actually delivered it. While streaming technology was early and teetering on the edge of viability, the real challenge was maneuvering the studios to license content that they didn't want to license because they wanted to retain absolute control. They were very averse to streaming for multiple reasons. The gambit of using DVDs in a series of Hobson's choices for the studios almost worked but ultimately failed at the late stages for an important reason that was difficult to bridge.
- wahern 4y agoFrom Netflix's IPO prospectus, dated May 22, 2002: > We currently provide titles to our subscribers on DVD only. However, we continue to monitor additional delivery technologies and, when appropriate, believe that we are well-positioned to offer digital distribution and additional delivery options to our subscribers. And further down, a bullet point in their growth strategy section: > Implementing Digital Delivery. We continuously monitor the development of additional digital distribution technologies. Historically, new technologies, including the VCR and more recently the DVD player, have led to the creation of additional distribution channels for filmed entertainment. We intend to utilize our strong relationships with the studios to obtain rights to acquire and deliver filmed entertainment through emerging digital distribution platforms as they become economically, commercially and technologically viable for those subscribers who prefer digital distribution. And later, regarding competition: > We believe that our strategy of developing a large and growing subscriber base and our ability to personalize our library to each subscriber by leveraging our extensive database of user preferences positions us favorably to provide digital distribution of filmed entertainment as that market develops. https://www.sec.gov/Archives/edgar/data/1065280/000101287002002475/d424b4.htm https://www.sec.gov/Archives/edgar/data/1065280/000101287002... Streaming on the internet was already exploding by 1997; relatively speaking, of course. I distinctly remember first watching South Park--myself and several other students, working in the computer lab technical assistance office for work-study, huddled around a Mac. This likely would have been circa 1998-1999, if not late 1997 when it debuted. (In fact, I don't think I ever watched South Park on cable television until many years later, while staying at hotels.) Around that time I also remember a major, well-funded streaming website that was supposed to revolutionize Indie film distribution. Anybody working in computing or the film industry knew where distribution was heading--the only question was when all the pieces would come together to make it viable, broadband adoption being the most important. (Not sure if a majority of American households were yet "online", but if not that was already a rapidly approaching inevitability.) There were many ventures which dove in too early. While I wasn't paying attention to (or even knew much about) Netflix before it's IPO, certainly by then it was well recognized--and recognized as brilliant--that Netflix's strategy was to build relationships with studios and rights holders on the one hand, and customers on the other, precisely to position themselves to dominate digital distribution when the time came. Online DVD rentals was the ramp, permitting them to build momentum so they'd have a head start ahead of anybody else in the digital distribution space. And it worked spectacularly; it took nearly a decade, if not more, for anybody to even come close to Netflix's lead. (Wikipedia says Netflix began streaming in 2007, same year as Hulu, but Netflix was still dominating until only a few years ago.)
- mwlp 4y agoI follow Marc Randolph on Tiktok and he's spoken before that they knew things would eventually go online: https://www.tiktok.com/@marc_randolph/video/7079079298182909230 https://www.tiktok.com/@marc_randolph/video/7079079298182909...
- gardenhedge 4y agoIs there anything to support that history? Documents from that 1997? Considering the company was founded by just trying to come up with random ideas I doubt they had too much foresight.
- serf 4y agoit absolutely was a tech company. the 'Cinematch' recommender , replaced eventually, was one of the differences brought-up in the netflix/blockbuster lawsuits.
- deleted 4y ago[deleted]
- gumby 4y agoThey were a tech company of their time: they had an excellent web site, search (and recommendation IIRC) etc, especially compared to most of their contemporaries. Nowadays I wouldn't consider anyone in the DVD-renting business to be a tech company. I would still consider Netflix a tech business under their current business model. Note that Netflix is relatively small and not really in control of their fate; they were presumably included in the "FAANG" acronym to make it fun. Now that two of those companies have changed their name it doesn't even fit (A, A, A, M and...N? Not the other M?)
- jedberg 4y agoNetflix was included in FAANG because it was a high growth tech stock, growing faster than all the others when it was included. It was the fastest growing stock on the market multiple times in the 2010s and was the fastest growing stock for the entire decade.
- adql 4y ago> (A, A, A, M and...N? Not the other M?) Well now we can say "MAAAAN it went downhill"
- pmoriarty 4y ago"Nowadays I wouldn't consider anyone in the DVD-renting business to be a tech company." Netflix still rents DVDs.[1] I actually much prefer their DVD service, because their selection of movies on DVD is infinitely superior to their streaming service, whose selection is absolutely atrocious. Netflix's streaming service might have world-class delivery, but what they deliver is crap. [1] - https://dvd.netflix.com/ https://dvd.netflix.com/
- Mistletoe 4y agoSending dvds all over the USA with such quick turnaround was more impressive to me than streaming video.
- myhf 4y agoRecommendation accuracy was much more important for DVD rental, because of the wider selection of content and the slower feedback loop. So a good recommendation algorithm was a core competency for the business.
- lr1970 4y agoAnd when seeing his internal recommendation algorithm team hitting the wall in recommendation accuracy, Hastings boldly created a 1M$ "Netflix Prize" competition to create a better recommendation algorithm [0]. This boosted research efforts in the field and earned him and Netflix respect in ML academic circles. [0] https://en.wikipedia.org/wiki/Netflix_Prize https://en.wikipedia.org/wiki/Netflix_Prize
- noboostforyou 4y ago> At that time it wasn't a tech company was it? At that time you would have to physically shop at Blockbuster to pick out a movie to watch. With Netflix you picked what you wanted to watch online, maintained a queue and they would automatically send you DVDs through the mail. It was absolutely a tech company since its inception.
- fnordpiglet 4y agoPure products were amazing. I always found the way Quantify represented profiling to be incredibly helpful back in the ancient days. I know there’s more advanced visualizations but I always found the logarithmically scaled directed edges in quantify to speak to me better than flame charts and other related techniques, I think because it represented the full execution graph rather than individual transactional paths. Anyway huge respect for Reed as an engineer and have always been impressed with both Netflix and the quality of the performance, debugging, and other efforts that have come out from them. He clearly values excellent engineering.
- iot_devs 4y agoDo you have a picture of these "logarithmically scaled directed edges"? I can imagine what you mean but a visual aid would be super useful.
- fnordpiglet 4y agoI kagi’ed around and I can’t, sorry. The software is 30 some odd years old and was acquired by IBM and sublimated as all ibm acquisitions do. But my memory of it could well be approximated by using dot to create nodes for execution points with edges to calls that are rendered with a weight proportional to the log of the execution time. The nice thing is it allowed for recursive calls to be rendered as cycles, and there are a lot of non recursive cycles I found. It also did a reasonably good job of clustering so highly popular calls fanned into a sub graph but with each graph calling in clustered independently.
- iot_devs 4y agoThanks a lot! I appreciated the description anyway!
- mark_l_watson 4y agoPure was an amazing product. For C++ development, we relied on it for my team at SAIC, and when I moved to Angel Studios (we developed games and content for Nintendo, Sega, Disney) I immediately asked the owners to purchase a company license. I saw Reed Hastings being interviewed on YouTube last night - fascinating how he has so many personal friendships with CEOs of competing companies.
- hodgesrm 4y agoPurify could find memory errors in just a few minutes that would take engineers days or weeks to track down. The dynamic instrumentation capability on existing binaries was huge. The first time I saw it in use was at Sybase. Running a demo version for an hour found enough problems that we instantly sprang for the license.
- timeimp 4y ago>Angel Studios Was this the company that made Midtown Madness 2?
- SanjeevSharma 4y agoI worked at Rational Software when we acquired Pure software. We sold tons of Purify+. The legend of course was the Hastings took the $ he made from selling Purify to Rational to start Netflix. So as a Rational employee, I had a contribution to Netflix's existence... Or so I like to tell myself ;).
- ivanech 4y agoI have a copy of the Pure Software Engineering Handbook which was created for internal use only. It's amazingly comprehensive and well-organized. I've never seen any kind of onboarding that comes close.
- ryandrake 4y ago
- acdha 4y agoIt’s worth questioning but he wasn’t a big deal in the early 90s and if Wikipedia is correct he finished a Stanford CS MS in B 1988. This seems very much in character.
- vosper 4y agoHave no doubt in this case - a sibling comment explains that Netflix was founded 5 years after this paper. https://news.ycombinator.com/item?id=33859953 https://news.ycombinator.com/item?id=33859953
- eschneider 4y agoThat's not how it usually happens in my experience. In this specific case, I worked at Pure Atria back in the day and it was my impression that Reed had some hacker chops.
- IncRnd 4y ago> EDIT: Wow. OK, I guess I'm the only one in the world who's ever seen that happen. It happens regularly in larger companies. Most patents that I have also have others on them, because secondary people had to approve my applications. That's just how these things work. The only exceptions to this are those patent applications that I approved for others. Remember, work on a patent may be more complex than the work on a corresponding invention. Also, the patent must be useful to the company in order for them to cover the bill. Taking a single employee's word for that is not enough.
- keepquestioning 4y ago
- geophile 4y agoPurify was a fantastic tool. I was so surprised to find out that he went on to found Netflix.
- bitexploder 4y agoI remember using that and libefence in the 90s to find memory leaks in my MUD. Purify was better. Easier to use and found more stuff. It is 2022, leaking memory still a problem.
- curiousDog 4y agoHaving met him before, his clarity of thought just comes across in this paper as well. Some people are just wired with that talent that makes me so jealous. Reed is one of those people with high EQ and IQ (with the ability of handle his inner Elon diplomatically)
- inferiorhuman 4y ago[flagged]
- nxmnxm99 4y ago
- inferiorhuman 4y agoWho's envious?
- chitowneats 4y agoThe one with "inferior" in their handle.
- inferiorhuman 4y agoAnd what am I supposed to be envious of?
- deleted 4y ago[deleted]
- rowanG077 4y agoWhat's worse? Hating people you have never met or idolizing people you have never met? Maybe spend your energy elsewhere instead of getting so worked up that you have to start calling people names.
- jdp23 4y agoBack in the day Reed told me that he added the leak detection to Purify v1 towards the end of the dev cycle and was very surprised that it wound up being one of their biggest selling points
- deleted 4y ago[deleted]
- ryanmccullagh 4y agowhat's the difference between this and valgrind?
- projektfu 4y agoA major difference is that purify is a binary transformation performed before or after linking. Valgrind/memcheck is a virtual machine that jit-compiles executable code and adds its instrumentation in the process. So, with purify, your linked executable includes the checks. With valgrind, the unmodified executable can run with or without checks.
- GuB-42 4y agoAnd for a more practical comparison: https://valgrind.org/gallery/survey_03/q4.html https://valgrind.org/gallery/survey_03/q4.html The takeout is: valgrind is free and doesn't require recompilation, purify has a more complete UI, they both have similar performance impact and bug-finding abilities.
- projektfu 4y agoAlso, Purify runs on Windows.
- wallstprog 4y agoI used Purify back in the day, and while it worked well, getting it working was a royal PITA. IIRC it was necessary to recompile EVERYTHING with Purify. Anyway, I would think the gold standard these days is clang's Address Sanitizer (https://github.com/google/sanitizers/wiki/AddressSanitizer https://github.com/google/sanitizers/wiki/AddressSanitizer). clang/ASAN also runs on Mac in addition to Linux.
- kccqzy 4y agoHaving never used Purify back in the day, I really wonder, do you think address sanitizer is an adequate or better replacement for Purify?
- jll29 4y agoI hadn't realized Pure and Netflix had the same founder; Purify was an amazing tool, which we had a license for HP-UX at uni. It was the kind of software where you knew you'd ask for it to be bought by any future employer.
- rajnathani 4y agoRecently I was thinking about how the Netflix software strategy of hiring only experienced engineers [0] (and paying them really well), is pretty beneficial for almost any tech team/company. Things like the CS experience that Reed Hastings has, seems like the key driver here. [0] https://www.teamblind.com/post/Why-Netflix-only-hires-senior-engineers-PXPQneh0 https://www.teamblind.com/post/Why-Netflix-only-hires-senior...