3 ms·

The problem of large instances is not just on the amount of users that you have, is on the amount of followers that your users have. E.g, imagine you have one

The problem of large instances is not just on the amount of users that you have, is on the amount of followers that your users have. E.g, imagine you have one user in your server that has 100k followers, spread around ~1000 instances. Each new message from this user triggers a push to these instances, and each of these instances will then make a request to you at the same time. Then, add to this that each of followers may trigger another request to your server in case the message has an embedded card or image. On a centralized system like Twitter this does not happen, on the fediverse this may lead to a self-DDOS.

ndriscoll 3y ago
If you're pushing, why would the other instance pull from you? Do one or the other. You also don't need to push for each post. You can batch push once per second or whatever. Push the image too so they don't request from you. Again, this may not be how mastodon works, but mastodon is clearly designed poorly. I have systems at work that have no problem gossiping thousands of updates per second to hundreds of subscribers. You also don't have to have a single global federated network to have a useful system. If North America were isolated from Europe or India that would still be useful to tons of people. Or people might segregate into communities based on interest, and don't need to send the same tweet to different communities since it's not relevant to both groups.
- rglullis 3y ago
  > If you're pushing, why would the other instance pull from you? Because instances are not always assumed to be online, or you don't want to push to all the connected instances... > I have systems at work that have no problem gossiping thousands of updates per second to hundreds of subscribers. So, I agree with you [0], but it seems that the Lemmy devs think it is not necessary. Be a kind soul and show your PR? [0]: https://github.com/LemmyNet/lemmy/issues/3245#issuecomment-1601644229 https://github.com/LemmyNet/lemmy/issues/3245#issuecomment-1...

ndriscoll 3y ago

If you're pushing, why would the other instance pull from you? Do one or the other. You also don't need to push for each post. You can batch push once per second or whatever. Push the image too so they don't request from you. Again, this may not be how mastodon works, but mastodon is clearly designed poorly. I have systems at work that have no problem gossiping thousands of updates per second to hundreds of subscribers. You also don't have to have a single global federated network to have a useful system. If North America were isolated from Europe or India that would still be useful to tons of people. Or people might segregate into communities based on interest, and don't need to send the same tweet to different communities since it's not relevant to both groups.

rglullis 3y ago
> If you're pushing, why would the other instance pull from you? Because instances are not always assumed to be online, or you don't want to push to all the connected instances... > I have systems at work that have no problem gossiping thousands of updates per second to hundreds of subscribers. So, I agree with you [0], but it seems that the Lemmy devs think it is not necessary. Be a kind soul and show your PR? [0]: https://github.com/LemmyNet/lemmy/issues/3245#issuecomment-1601644229 https://github.com/LemmyNet/lemmy/issues/3245#issuecomment-1...