3 ms·
Yes, for starters they wrote things like Kafka and Samza there @ LinkedIn. I consider this post required reading for anyone wanting to build serious business di
by SEJeff 10y ago
Yes, for starters they wrote things like Kafka and Samza there @ LinkedIn. I consider this post required reading for anyone wanting to build serious business distributed data pipelines, and guess where it came from? :)
https://engineering.linkedin.com/distributed-systems/log-what-every-software-engineer-should-know-about-real-time-datas-unifying https://engineering.linkedin.com/distributed-systems/log-wha...
- eternalban 10y agoMicrosoft's technology portfolio & research /far outstrips/ anything LinkedIn did or would encounter. I'd guess that this appointment is Cloud/Azure related.
- SEJeff 10y agoSure, and it is also likely 100x the size. That wasn't the original question, the question was what has LinkedIn done engineering wise. I'd say Kafka was a pretty smashing success having met all of Neha, Jun, and Jay Kreps and talked Kafka with them.
- clumsysmurf 10y agoThanks for the link. I noticed their idea of "unified log" in a diagram about 45% of the way down. Does anyone know if this is the same thing talked about in the forthcoming Manning book "Unified Log Processing"? https://www.manning.com/books/unified-log-processing https://www.manning.com/books/unified-log-processing
- alexatkeplar 10y agoHey clumysmurf - author of the book here; yes indeed, the book is heavily influenced by Jay Kreps' LinkedIn paper.
- catwell 10y agoVoldemort was pretty influential too, even though it has been eclipsed by Cassandra.