4 ms·
This sounds like a promising book. I read the The Idea Factory a few years ago, which is a related and fantastic book about the history of Bell Labs. Around t
by chubot 9y ago
This sounds like a promising book. I read the The Idea Factory a few years ago, which is a related and fantastic book about the history of Bell Labs.
Around that time I came across an interesting idea. I don't remember if it was in the Idea Factory, or in material I read afterward, but it's related to one of central ideas from this excerpt:
The sender no longer mattered, the intent no longer mattered, the medium no longer mattered, not even the meaning mattered: A phone conversation, a snatch of Morse telegraphy, a page from a detective novel were all brought under a common code.
The idea I came across is that:
Shannon's information theory, devised at AT&T, indirectly led to the demise of AT&T's monopoly.
Before Shannon, there was no concept of the information-carrying capacity of a wire. And AT&T's monopoly was largely due to it having the biggest set of wires, which as you can imagine were expensive to deploy in the 19th/20th century. I remember that calling California from NYC was a huge achievement, precisely because of the number of physical wires that had to be connected. AT&T was the first to offer that service.
So I think the argument was that it made economic sense for a single organization to own all the wires, so it could maintain them with a set of common specifications and processes. But if you can reduce every wire to a single number -- its information-carrying capacity -- then this argument goes out the window. You can use all sorts of heterogeneous links made by different manufacturers and maintained by different companies.
(I'm not sure if this is historically accurate, but technically it sounds true.)
So my thought was that there's an analogous breakthrough waiting to happen with respect to cloud computing. Google and Facebook have information monopolies based on centralized processing of big data in custom-built data centers. Likewise, AWS has a strong network effect, and is hard to compete with even if you have billions of dollars to spend.
So my question is: Is it possible there will be a breakthrough in decentralized distributed computing? And could it make obsolete the centralized cloud computing that Google/Facebook/Amazon practice? Just like AT&T had no reason to be a monopoly after Shannon, maybe a technological breakthrough will be the end of Google/Facebook/Amazon.
Maybe this idea is too cute, and you can poke holes in it on a number of fronts, e.g.:
- Shannon's ideas were profound, but they didn't actually bring down AT&T. AT&T was forcibly broken apart, and there are still network effects today that make re-mergers rational.
- Centralized distributed computing will always be more efficient than decentralized distributed computing (?) I'm not aware of any fundamental theorems here but it seems within the realm of possibility. (EDIT: On further reflection, the main difference between centralized and decentralized is trust, so maybe they're not comparable. Decentralized algorithms always do more work because they have to deal with security and conflicting intentions.)
But still I like the idea that merely an idea could end an industry :)
Relatedly, I also recall that Paul Graham argued that there will be more startups because of decreasing transaction costs between companies, or something like that. But it still feels like the computer industry is inherently prone to monopolies, and despite what pg said, the big companies still control as much of the industry that Microsoft did back in the day, or maybe more.
- andars 9y agoI believe you are thinking of The Idea Factory.
- chubot 9y agoOops thanks, corrected. The Genius Factory was also a good book, about a crazy effort to make a Nobel Prize sperm bank. :) If I recall correctly, that book included a distant relative of Edward Teller, or possibly it was some other Bell Labs luminary.
- zrm 9y ago> So I think the argument was that it made economic sense for a single organization to own all the wires, so it could maintain them with a set of common specifications and processes. But if you can reduce every wire to a single number -- its information-carrying capacity -- then this argument goes out the window. You can use all sorts of heterogeneous links made by different manufacturers and maintained by different companies. > (I'm not an electrical engineer, so I have no idea if this is all true, but it sounds plausible.) You're describing the internet. :) > Is it possible there will be a breakthrough in decentralized distributed computing? The hard problem is security. Right now you have to trust Amazon et al with your data, which is not really what you want, but even that is better than having to trust Some Guy running a host out of his garage. This isn't a real problem for static content. That you can just encrypt, throw it up on IPFS or similar and add federated authentication for access to the decryption keys. But data processing is something else. There are people trying to solve that with encryption too, but it's hard, and to a large extent equivalent to making effective DRM, which is not a desirable thing for your problem to be equivalent to. A different approach is to trust people who you actually trust. We're now at the point that a fast processor consumes a single digit number of watts. So you can run your own server at home, and so can your friends and family, which allows you to pool capacity for load sharing and higher availability. Then services become software you install on your trusted pool of servers. There is no technical reason that can't exist, people just haven't done it yet (or they have but the future is not evenly distributed).
- chubot 9y ago