3 ms·
You can't build a Twitter clone in a decentralized way and expect to have good performance on the analytics side. This is a basic practical limitation. The pow
by wslh 11y ago
You can't build a Twitter clone in a decentralized way and expect to have good performance on the analytics side. This is a basic practical limitation.
The power of Twitter is having a single firehose where you can hook and analyze ALL the tweets.
- narrowrail 11y agoFirst, I don't understand why one couldn't federate their instance with every other instance, essentially creating a firehose. It's not as if Twitter runs on a single machine. Secondly, I do not think most users care about "performance on the analytics side" which seems more like a business need.
- wslh 11y agoSorry, I don't want to be pedantic but this is a constraint on distributed systems. Like Google Search, Twitter doesn't run on a single machine but it is a very cohesive and optimized system (e.g: high speed networks, storage and performance).
- sounds 11y agoAnd when a viable solution to the constraints imposed by CAP theorem arises? I would think that will happen sooner rather than later.
- mikegerwitz 11y ago> You can't build a Twitter clone Replacement, not clone; I don't care if it has all the features of Twitter. There are some instances that are more Twitter-like (e.g. Quitter), but they don't interest me. For me, personally, this has nothing to do with cloning Twitter. For others it might, but I think that is misguided. > in a decentralized way and expect to have good performance on the analytics side I'm not sure that this matters. As a user, I'd prefer that there _not_ be traditional analytics, because centralized services' analytics amount to surveillance. > The power of Twitter is having a single firehose where you can hook and analyze ALL the tweets. Federation doesn't prevent another service from collecting and performing its own analytics on a federation. It certainly wouldn't be as performant, sure---but that's not the issue that we're addressing. A decentralized service is worth any performance cost for many of us.
- wslh 11y agoFirst, we are talking about different things if you don't want to clone Twitter. > Federation doesn't prevent another service from collecting and performing its own analytics on a federation. This will not be in realtime and that is my main point on the difficulty to replace Twitter. The "tweet" of an user alarming of an earthquake will take much longer than on a centralized system.