4 ms·
A nice survey of the topic can be found in Total Order Broadcast and Multicast Algorithms: Taxonomy and Survey, Xavier Défago, André Schiper, Péter Urbán, 2004[
by pron 11y ago
A nice survey of the topic can be found in Total Order Broadcast and Multicast Algorithms: Taxonomy and Survey, Xavier Défago, André Schiper, Péter Urbán, 2004[1]. Interestingly, the unexpected fame of the CAP theorem and especially its various misinterpretations has done some harm to this field of distributed systems when people started believing that eventual consistency is the only way to achieve the scalability requirements of their applications.
On the JVM, the best group communication infrastructure is the terrific JGroups library[2]. On .NET (and soon the JVM, too) there's Vsync (Isis 2)[3]. For C/C++ (with Java and Python binding), there's Spread[4]. All three are heavily inspired by the work of (or, in the case of Vsync/ISIS, directly created by) Ken Birman of Cornell, and implement group membership and leader election, atomic multicast, failure detection and more.
[1]: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.102.3146 http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.102....
[2]: http://jgroups.org/ http://jgroups.org/
[3]: http://vsync.codeplex.com/ http://vsync.codeplex.com/
[4]: http://www.spread.org/ http://www.spread.org/
- buckbova 11y agoI couldn't reach the https version of the vsync site. Perhaps it's my company's web filtering. This worked. http://vsync.codeplex.com/ http://vsync.codeplex.com/
- toast0 11y agoSuper offtopic, but it looks like they only support SSL3 and TLS1.0, you might have something that does TLS1.2 only.
- padobson 11y agoLet's say I wanted to prove to a future employer that I had learned how t build a distributed system with a practical example, but my current employer doesn't require a distributed system. How could I go about doing this in a side project?
- rhgraysonii 11y agoYou should dive into Mesosphere. The resources available are quite robust. With only a tenuous grasp on the larger concepts I was able to architect a system with Mesos + Chronos for job queueing and Marathon for container deployment and moved some of my hobby projects to it. For less than $150 a month or so you could provision 3 primary and 3 worker boxes and get a start. And once you have a real system, you can start looking into the principles of the underlying pieces such as Zookeeper etc.
- macintux 11y agoImplementing the Raft protocol[1] has been a popular activity over the last couple of years. Amazon's Dynamo paper[2] is also easy enough to grasp to build a prototype of a distributed key/value store. [1]: https://raft.github.io https://raft.github.io [2]: http://www.allthingsdistributed.com/files/amazon-dynamo-sosp2007.pdf http://www.allthingsdistributed.com/files/amazon-dynamo-sosp...
- kylixz 11y agoJust out of curiosity... have you used JGroups before? I've heard negative things about it but wasn't sure if those were unfounded or maybe just early versions. Any thoughts of how these compare to something like the Data Distribution Service (DDS) for group communication? [DDS]: http://portals.omg.org/dds/ http://portals.omg.org/dds/
- pron 11y agoYes, I have, and found it great (i.e. no more problems than any other library I've used). It is under (very) active development (by the same developer for 17 years now), who is also very responsive on the mailing list. JGroups serves as the foundation for JBoss Infinispan. I don't know much about DDS (except that a company I used to work for bought the RTI implementation, and it was quite expensive).
- monocasa 11y agoI can't speak for JGroups (definitely going to check that out tonight), but spread and Vsync/ISIS both struck me as perfect examples of the meme of poor quality academic code. Spread is an #ifdef soup containing scary stuff like "#ifndef _REENTRANT" in their hello world examples. Additionally it has a weird not quite BSD licence that doesn't look compatible with the GPL. It also makes you send them either an ssh key to checkout from subversion, or send them email/name/company info just to get the download link working. Vsync/ISIS is a single 50KLOC C# file that spawns upwards of a dozen threads on init. IMHO there's room for someone with more of a software engineering background to come in and clean them up (assuming that this person/group knows enough about distributed systems to clear things up without introducing more problems).
- yid 11y ago> spread and Vsync/ISIS both struck me as perfect examples of the meme of poor quality academic code. I was about to say that academic code is almost always poor quality, but that should never, ever apply to distributed systems code. If there's one thing we should see from academic distributed systems research, it's principled, well-constructed, solidly tested libraries, rather than wannabe commercial databases written by graduate students.
- pron 11y agoOf the three, JGroups is the only one I have used. It is definitely not academic, and it serves as the infrastructure for JBoss Infinispan.