5 ms·
Is Twitter causally-consistent?
- d33 8y agoCould someone explain casual consistency to me? Is it just about not showing earlier messages to someone who got blocked, or is there something more to it?
- ishitatsuyuki 8y agoA good article on this: https://jepsen.io/consistency/models/causal https://jepsen.io/consistency/models/causal
- anonymousDan 8y agoAnd another: https://www.usenix.org/system/files/login/articles/08_lloyd_41-43_online.pdf https://www.usenix.org/system/files/login/articles/08_lloyd_...
- mav3rick 8y agoIf B happened as a result of A, then every node should observe A BEFORE B. For instance, "Deleting an ex (A) and posting a relationship with a new SO (B)". If this social network wasn't causally consistent then - Your ex may see your life update (and then be deleted). I may be wrong, so other experts feel free to correct me.
- bonoboTP 8y agoWhy call it causal though? It seems like temporal consistency to me. What's the causation aspect?
- beaconstudios 8y agobecause the thing that needs to be maintained is the causal ordering of events. For the example from TFA, block -> tweet and tweet -> block have the causal effect of the blocked user seeing or not seeing the tweet respectively. Phrasing it as causal ordering removes time from the equation, which you aren't always able to take into account with distributed systems. Causal ordering also allows for causally unrelated events to appear in any order, for example updating your bio and posting a tweet. Check out the wiki article on logical clocks for a rough starting point in delving into this topic: https://en.wikipedia.org/wiki/Logical_clock https://en.wikipedia.org/wiki/Logical_clock.
- kd5bjo 8y agoA more common example of causally unrelated events is two people tweeting from different parts of the world that don’t follow each other. The order these appear somewhere really doesn’t matter to anyone.
- deleted 8y ago[deleted]
- Liquid_Fire 8y agoBut there is no causal relationship between the two events. You didn't tweet because you blocked the person, or block them because you tweeted. This blog post is really about sequential consistency.
- beaconstudios 8y agono it isn't. The two events are linked by a effect, ie switching the order of events has a different effect. They are causally linked, but not in the a => b sense. It's not about sequential consistency because for many other sets of events, the order does not matter and thus doesn't have to be enforced.
- thebootstrapper 8y agoRead this paper[1], it explains various consistency in distributed system by using baseball scores updated over different medium. [1] https://www.microsoft.com/en-us/research/publication/replicated-data-consistency-explained-through-baseball/ https://www.microsoft.com/en-us/research/publication/replica...
- svdr 8y agoCausal, not casual :)
- mav3rick 8y agoI find designing for different consistency (trade offs with scale etc.) models super interesting. Where can I find work like this ? I am assuming at big companies this work is already done. Any distributed systems experts here that can point me to some companies and / or small projects I ca build on the side.
- beaconstudios 8y agodatabase design runs into these trade-offs a lot. CAP theorem is the canonical example.
- devxpy 8y agohttps://youtu.be/YAFGQurdJ3U https://youtu.be/YAFGQurdJ3U Here is a nice, technical talk on distributed databases
- baq 8y agoread all of this https://aphyr.com/tags/jepsen https://aphyr.com/tags/jepsen chronologically
- mav3rick 8y agoI've read and watched a lot of resources, thanks for more links :) Any pointers on companies that may hire for such jobs ?
- pvarangot 8y agoMartin Kleppmann's book Designing Data-Intensive Applications has two chapters where it talks about consistency (one about replication and another one about consensus and consistency). That books reference sections for each character are goldmines. The work is never "completely done" because most of the known or reliable solutions involve choosing tradeoffs with scalability, speed or data locality, so you can always go bespoke to optimize for the current business needs, and when they change you may need to change protocols or algorithms again.
- snowwrestler 8y agoIsn’t this a known feature of Twitter, usually called a soft block or forced unfollow? You block and unblock someone quickly and it forces them to unfollow you (and more importantly, does not signal them that it happened). I have heard of people fearing harassment to use this technique to get themselves out of a person’s timeline (out of sight, out of mind) without the pseudo-confrontation of a block.
- iainmerrick 8y agoMaybe... but known to whom? Is it documented?
- madeofpalk 8y agoI'm not sure about twitter, but my housemate was talking to me about how she would use this technique on Instagram to get people from unfollowing her. It's no longer required because you can do that explicitly now.
- x5315 8y agohttps://developer.twitter.com/en/docs/accounts-and-users/mute-block-report-users/api-reference/post-blocks-create https://developer.twitter.com/en/docs/accounts-and-users/mut... "If a follow or friend relationship exists it is destroyed."
- michaelmrose 8y agoIsn't it weird that someone else controls this. It seems like a website removing itself from your bookmarks. Maybe twitter could instead work on not being a terrible way to communicate coherent thoughts to each other instead.
- deleted 8y ago[deleted]
- wafflesraccoon 8y agoI would argue that it is closer to being unfriended on Facebook than a website removing itself from your bookmarks.