14 ms·
The Federation Fallacy (2019)
- c-linkage 5y agoI agree with the fundamental hypothesis, but the proposed "democratic" web suffers from the same fundamental problem as the federated model: how is it paid for in sweat and treasure? Most people want to use the internet, not run the internet. No one (outside of some die-hards who will no doubt explain below) wants to run their own infrastructure -- it takes too much effort to do correctly and otherwise distracts from the end goal -- actually using the internet. The "democratic" web will need to be paid for, but everyone is used to getting internet for a flat fee from their ISP, so no one will pay for a VPS they have to manage (again, outside of some die-hards who will no doubt explain below) because why pay for the cow when the milk is free. That's right: the reason centralization wins is because its "free" to the user, at the cost of privacy and advertising. The only way to get the "democratic" web envisioned is to use the democratic version of the same behavior that the best centralized companies use: get a guaranteed revenue stream. That's right, to get a democratic web you will need to raise a tax and have the government run (or otherwise subsidize) the infrastructure.
- coop_solution 5y ago> That's right, to get a democratic web you will need to raise a tax and have the government run (or otherwise subsidize) the infrastructure. Is this the terrible conclusion that you were building up to? I see no problem with that compared to the alternatives (existing or non-existing).
- bdauvergne 5y agoMaybe we could call this tax a subscription and contrary to nation state that you have to belong to on birth, your could choose your "internet state" by subscribing. You would get some rights to access the infrastructure of this internet state (mail, DNS, micro-blogging, whatever...) and participate to its administration by voting and have some obligations (pay your subscription, vote, validate identity of people, participate to arbitration instances). I think this kind of corporation is called a cooperative, maybe the destiny of the free-internet are cooperatives. Federation between those virtual states would have a precedent, existing federation of real states.
- c-linkage 5y agoVoluntarily paying for subscriptions is exactly what people _don't_ want to do when an equivalent service can be had free of monetary charge. Also, the largest problem with "subscribing to your tribe" is that on the internet your email address is often your identity. If I have a falling-out with Tribe A and need to move to Tribe B, now I have the hassle of changing over all of the accounts using by Tribe A identity to use my Tribe B identity. This only gets worse when I have to move my entire blog and maybe even DNS entries (assuming I wanted the added hassle of managing my own domain in the "democratic" internet). Changing identity is the "payment in sweat" I mentioned above. Most people will make the a priori decision that changing identity is too much work and instead favor the centralized systems like Google to manage identity.
- bdauvergne 5y agoThat's clearly not different you can also change your email from Google to Live but you also have to pay in sweat as you say. The difference is you can have some control on your "tribe" as you call it because it's a democratic human organization where Microsoft and Google are sort of oligarchic human organizations, some people have power over them, you're just unable to be part of those people for actual money/power reasons. As I said I see no technical/organizational reason why techniques advocated for radical decentralization (like blockhain, dht, name-independant routing, etc..) could not be used to make the necessary sweat to move from a tribe to another easier (as there are political framework like the European Union which makes it easy to move your life from France to Germany or the reverse); move you signed DNS record from tribe 1 to tribe 2 so you move routing of your email, give some capability to tribe 1 to sync your data from tribe 2, and forgot about tribe 2. If tribe 2 is unreliable and still advertise that it should receive your email, you can do nothing, people in tribe 2 will lose contact with you. But if (real material) state A claim you are a criminal, and state B give you asylum that's great, but it won't make the danger of returning to state A disappear. I think that the case where tribe would be adversarial is an edge case, the same way Live and Google do not block each other emails. Anyway what I say will only verify if some people try it, make a global "user of internet association" with some kind of constitution for governing it democratically, amass some capital, create some infrastructure a la google-suite and see where it goes. If nobody adhere to it, I was wrong :) It seems that in this setting many current technology which needs some trust anchor to have some kind of performance become simpler (global ledger, secure name system, etc..) and very powerful.
- amsha 5y agoOne unmentioned feature of federation is that it lowers the cost of switching. If your provider begins to misbehave, you can jump to another one. This is especially true in email, where you can move from one host to another by updating your domain's MX records. Without federation, switching means migrating both your host and your network of participants simultaneously. That is a much harder and more expensive coordination problem.
- saurik 5y agoYou are analyzing the wrong thing: email as a hosting mechanism isn't exactly federated, it is the email addressing scheme that is federated. You happen to be self-hosting your domain (which is part of a different system: DNS, which is more hierarchical than federated, though I have often put it in the latter category), which allows you to move around and even delegate to third parties your email host (which is really what you are doing: federation isn't what is allowing you to delegate your hosting provider, as your hosting provider works for you and you alone), but at the email layer that's because you did the super-rare thing of owning your own domain name and knowing how to have an MX record. The switching cost for the average user of a federated system--one which has experienced lock-in on someone else's naming system, such as by using a gmail address or having a mastodon account on a large instance--is brutal. There is an advantage here that that is even possible, and there is then competition between these inter-compatible providers, but there are still many reasons why users tend to end up wanting to end up attached to larger namespaces (all of technical, political, and economical). Hell: even some of the smartest people I know seem to have an @gmail.com address (or worse: have let their identities become owned by a company they happen to work for) no matter how immediately "amateur" that makes them look to me :(. (I gave a short "talk" about this at the Distributed Web Summit a few years ago, but the video they took has an over-an-hour audio sync issue and I haven't taken the time to edit my own copy yet.)
- amsha 5y agoEmail federation is more than just the addressing system. Even with a consistent address, your host still needs to be able to send and receive SMTP messages to participate in the ecosystem. Address lock-in is real but doesn't fully negate the benefits of federation. Even if you don't control your address's domain, you can switch providers without losing the ability to send and receive email. There is extra cost in pointing your bank account to your new address, but it is possible. If your bank communicated to you via a non-federated protocol like WhatsApp, switching would be impossible.
- ajuc 5y agoI agree, and I think this model - centralized democratic open source server for most people + self-hosted version when you need it - is ideal. Without the centralized server somebody will take over with a proprietary walled garden that offers better user experience. Without the self-hosted version people with special use-cases will move to proprietary competition that will eventually distrupt the democratic well meaning version. Most recently I've seen it play out in virtual tabletop rpgs space. There is the proprietary centralized roll20.com that barely works because for the longest time it had no competition. Some of the premium features were broken for months. And there's foundry vtt which is much better, open source and self-hosted, but is hard to setup correctly on your own. What's missing is centralized democratic version of foundry vtt that will make it as easy as roll20 for new players and DMs. It's not like money is the problem - people in this hobby are used to pay for customized dies, figurines, books, maps etc. They could easily charge 100 USD a year for 4-5 person group and that will easily pay for the computing needed and bandwidth. Both of the groups in which I play chipped in for cloud server and a license of foundry no problem. The problem was configuring it and dealing with network issues.
- kkjjkgjjgg 5y agoIt is OK if most EMail user use Google. The important point is that if Google deletes my account or does something else I don't like, I can use another EMail provider, including one I set up on my own. Yes I know these days it still won't work because Google will censor my EMails and make it impossible for me to communicate with its users. But it is the general idea, and I think there are new systems (like Matrix) where censoring stuff would not be as easy. And if users are frustrated about not getting my EMails, they could also move away from GMail. Mastodon is also a bad example because it sucks or is weird. In theory users of different servers could communicate with each other, but my impression was that it is too complicated and not really encouraged. It was also invented for the specific purpose of being able to censor things, maybe that shows.
- klez 5y ago> In theory users of different servers could communicate with each other, but my impression was that it is too complicated and not really encouraged What do you mean? The rare times I use mastodon I can just reply to any toot from any instance and it just works.
- kkjjkgjjgg 5y agoYou can communicate p2p, but not really participate in discussions on other servers. At least it is not encouraged. Might only be a client issue. I don't remember the details, but I think it is the way messages from other servers show up in the timeline.
- ryukafalz 5y agoYou can, you just don't share the instance-local timeline. If you're mostly talking with people you follow and vice-versa, it all works pretty seamlessly. But people on other instances won't discover your posts via the local timeline, which is where a lot of people start when they first join. You might be visible in the global timeline depending, but that's a mess. :)
- sylvain_kerkour 5y agoDecentralization (and federation) is about choice. Choice to host your own data or delegate to a trusted party, not to have to follow the rules of a single company, with a single culture and within a single jurisdiction. In one word: feodalism.
- caaqil 5y agoInteresting article and I agree with most of it. But the argument that "Democratic freedom is incompatible with an oligarchic authority" is untenable. Ideally, they are incompatible, but in the real world, most so-called democracies today are effectively oligarchies. It's also amusing that the author chose Wikipedia as the example for this utopia. Wikipedia is awesome (mostly) but the idea that it's something where everyone participates and has the same access is simply absurd. The fact that Wikipedia editing still obeys the 1% rule is a sign. Not to mention the edit restrictions articles have where certain threshold of editing history must be met to circumvent them, the complex rules, tools and culture, the editing wars, etc. If Wikipedia is known for anything, it's that it's hostile to newcomers and that the elite dominates it (just look at the demographics of the editors). Not sure how grandma is supposed to have 500 edits for the privilege to edit an article about some politician. If our utopia is that, then we're back to square one.
- zozbot234 5y agoThe thing about Wikipedia is that users have the right to fork it, per its license, and have historically used it (see Encyclopedia-Libre). It's at least potentially a federated system, in a way that other comparable sites are not. Interestingly, the same is true of Stack Exchange/Stack Overflow: its content is openly licensed, so in principle you could use it to seed your own Q&A site if you objected to how the original was being run.
- quiet_cool 5y ago> its content is openly licensed Interesting, I know SE/SO itself is not open source: https://meta.stackoverflow.com/questions/313483/is-stack-overflow-open-source https://meta.stackoverflow.com/questions/313483/is-stack-ove... Wikipedia is apparently fully open source however: https://www.mediawiki.org/wiki/Download https://www.mediawiki.org/wiki/Download
- specialist 5y ago> ...most so-called democracies today are effectively oligarchies. I'd like a taxonomy of democracy. Or perhaps even a catalog of traits. Might help limit crosstalk. Like other nebulous ideas -- love, truth, self -- we're all using the same word to talk about different ideas. Twenty years ago, I reflexively rejected the very notion of sortition as ridiculous. I had spent a decade as an election integrity activist, deep diving into voting rights, election administration, and other arcana. I was utterly committed to the obvious virtue of the Australian Ballot. To the necessity of transitioning to Proportional Representation and Approval Voting. The hills I would happily die on. Now? Not so much. After reading David Graeber and rereading Chomsky and Jill Lepore's early history of polling (eg Gallup), I'm newly open to considering alternatives. Thoughtful deliberation sounds pretty fucking great about now. Stuff like citizen's assemblies to tackle thorny policy debates. And maybe polling is superior to voting, at least for some use cases. -- Any way. Current me agrees with both you and OC wrt democracy vs oligarchies. Restated, our current group decision making institutions and strategies are prone to capture, which then transmute democratic arrangements into oligarchies. We see this over and over again, big and small. Just witness all the coops (like farmers cooperatives) which are vulnerable to hostile takeovers, thereby disempowering the actual members. -- We need better technology. Something that is both more democratic and less resistant to capture. Is that even possible? Ever play Nomic? It's game which simulates the Paradox of Self-Amendment. Basically the game version of what we call a constitutional government. https://en.wikipedia.org/wiki/Nomic https://en.wikipedia.org/wiki/Nomic Or, we can just emulate our ancestors. According to Graeber and Wengrow (Dawn of Everything), many societies used culture and tradition (vs rulesets) to contain would be tyrants. Often thru violence.
- mab122 5y agoFew comments here mention that if you don't like your current provider you can easily switch - take your data with you. I think the problem of "not everyone wants to run things, everybody wants to use them" could be solved if we make our data fluid with something like IPFS (note: _something like_). What I mean is you can have data in multiple places a none is central one (discovery could be local, through friends and hubs etc. like SSB). You could have it on some federated server, on your local pc and if your provider misbehaves your data is still accesible from other places and moving it is no longer manual process where you have to click export, import etc. just login to other provider and that new service will pull your data from wherever it is accessible. I don't know if I am making any sense :D Please be forgiving. tl;dr; right now you address someone by nick@matrix.server or nick@mastodon.instance - we should be going in direction of adressing people using only _nick@service_ (or just _nick_) and dont care where the actual content is
- ivanbakel 5y agoI don't agree with the author's views on anarchism, and their analysis is missing a key piece of political thought: who has control of violence in their proposed system of a democratic internet? In the anarchist federated design, the answer is you, the individual. Even if the admin of your particular chosen federation instance chooses to boot you off and delete all your posts, you still hold a copy of your own data which you can take with you to another instance, or to even start your own instance. In the "democratic internet", the answer is you, via your vote - but only in principle. In reality, it's whoever holds the keys to the server you want to use. The ultimate authority over what goes on on Wikipedia is not its userbase, no matter how much of a voice they have: it's the people who physically control the hardware and software that Wikipedia is running on. The monopoly on violence that this "online state" holds over you is not a consequence of your own participation - it is a result of cold hard fact. Worse still, unlike a physical democracy, the "democratic internet" puts your experience of democracy under the control of this authority. If the very fabric of how you participate in an online system is manipulateable by the people in charge of that system, you have little-to-no protection against a coup - what do you do when someone deletes the code that lets you vote, or comment, or anything else? In a federated world, the protection you have is federation itself: a compromised instance is immediately abandonable in favour of any other instance. Personally, I find the idea of empowering tech illiteracy misguided. Computers are too powerful, and too complex, to allow foundations built on them to be written off as trustworthy. Trust in technology can only be based on a constant adversarial effort, participated in (or at least, possible for) every user. How we get there is a much harder problem, and the solution is not centralisation.
- ajuc 5y ago> In the "democratic internet", the answer is you, via your vote - but only in principle. In reality, it's whoever holds the keys to the server you want to use. The ultimate authority over what goes on on Wikipedia is not its userbase, no matter how much of a voice they have: it's the people who physically control the hardware and software that Wikipedia is running on. And in real-life democracy it's the same. Ultimately it's the army that has the tanks. > the "democratic internet" puts your experience of democracy under the control of this authority. If the very fabric of how you participate in an online system is manipulateable by the people in charge of that system, you have little-to-no protection against a coup - what do you do when someone deletes the code that lets you vote, or comment, or anything else? What do you mean by that? If wikipedia jumps the shark people can make a new wikipedia. If France turns into autocracy people can emigrate or revolt. It's pretty much the same.
- eoo 5y agoRegarding the distribution of users on Mastodon servers, the article seems a little biased. The author complains about how "an average of six hundred users per server" doesn't look like "every user knows the system admin where their data is stored". The median users per server would have been a fairer metric than the mean, specially because it later points out that three servers have over 50% of the users in the Mastodon ecosystem...
- eadmund 5y agoThe beauty of federation is that it provides an opt-out. Take a look at Mastodon, for example (FWIW, I am not a user): yes, at the time the article was written the vast majority of folks were on three instances (I am curious what it is like today), but if anyone disagreed with the policies or performance of those instances, he would be free to move to another instance, or set up his own. By contrast, there is no other Twitter which Twitter federates with. Likewise, a Gmail user is free to move to another email provider (there are large ones, unlikely to have deliverability issues), or run his own (a tricky enterprise, to be sure). FWIW, I am concerned that democratic rule has its own failure modes, which need to be addressed when designing a system. Do 50.000001% of users really get to permaban another user? Are there any actions which require a higher threshold, or multiple votes over time, or which are permanently forbidden? The U.S. Constitution has the advantage of a Bill of Rights, whose status has so far prevented the outright abrogation of any of them, even if some of them have come under quite a bit of pressure (the First, the Second, the Ninth & Tenth leap immediately to my mind). Just saying, 'the will of the majority controls' is a recipe for mob rule — which is exactly what 'democracy' means.
- coop_solution 5y agoCriticizing democracy because of majoritarianism is like criticizing programming itself because of how Perl, Ruby, or any other particular programming language works. Democratic governance can be implemented using consensus, majoritarianism, majoritarianism with a 60% threshold, or whatever other rule or stipulation. A constitution is of course also possible; then the people would decide on some ground rules which will be very hard to change for the foreseeable future. Which might be a blessing or a curse for the future people. > Just saying, 'the will of the majority controls' is a recipe for mob rule — which is exactly what 'democracy' means. You are not saying anything. Mob rule is indeed a pejorative term which is often used as a synonym for democracy. What of it? I could call you by some insult or other but I wouldn’t be making a point or an argument.
- pessimizer 5y agoIn a democracy of three, two people can vote to kill the third. That's why democracy is a problem, and that's why the bill of rights is amazing. Call it what you want. edit: democracy as a governance method must be built on consent, an agreement to abide by the outcome of the vote. No one would consent to a democracy without limitations. They're not even stable; they keep peeling off minorities until there are only two members left.
- trabant00 5y ago> But do you host your own mail server? Do your friends? Does your grandmother? No, but that's not the point. Being federated my friends can switch email providers (keeping their address too if they rent a domain) like they can do with gsm sercice and still communicate with their peers. They can not do that with facebook, teams, slack, etc. And they also end up having 3000 service providers installed on their phones/laptops/whatever. With 3000 logins to keep secure, 3000 software packages to keep up to date, 3000 services sucking up the battery, etc.
- catern 5y agoYes, yes, it's hard to self-host federated services, because system administration is hard. So we have to make it radically easier, then.
- ryukafalz 5y agoAgreed. Sandstorm in particular was and is a great example of simplifying system administration, and holds the most promise of anything in that realm IMO. I'm not sure if it's in a position to host federated services at the moment, but I know it's been talked about - if that can be made to work, it'd be the simplest solution I can think of.
- rkangel 5y agoThere is an assumption here that 'people hosting their own instances' is the ultimate goal and I don't think that's true. The important thing is that someone can always set up a new instance if they don't like the existing ones - competition isn't a perfect system but it tends towards providing the services users want. Without it though, you're locked in and stuck with what you've got. Also note that someone else providing you a service is not the same as someone else owning your data - a properly designed E2E encryption scheme can mean only you have your data.
- IndexPointer 5y agoShe seems to assume that federations are supposed to be small groups where everyone knows each other. Has anyone claimed that? Email and the web are the perfect examplea of federations, because they are not controlled by a single company; they are interoperable. From Gmail I can send an email to a friend who uses Outlook. That way I'm not forced to use outlook if I want to communicate with him and I can use any email provider I want. The fact that Google and Microsoft are trillion dollar companies is irrelevant here. Same with the web, I can change my ISP and keep accessing the exact same webpages as before because the web is federated, and not controlled by my ISP. The fact that I use it to visit pages controlled by other large companies is irrelevant. Facebook or Whatsapp, on the other hand, are not federated. If I want to communicate with my friends who use Facebook or Whatsapp I have no other choice than to use Facebook and Whatsapp.
- cletus 5y agoI have somehow not seen this post before. Thanks for posting it. I couldn't agree more. I particularly like differentiating between decentralization and federation. The key point here is that this is something almost nobody wants. I'm surprised the author didn't bring up what is probably the most successful large-scale federated system: the POTS telephone network. Spam calls, robocalls, caller ID spoofing, limited controls on blocking people, etc. There's a reason things like WhatsApp, FB Messenger and the like have grown so big. Many people now view the phone part of their smartphone as just a huge annoyance.