7 ms·
> 429 Too Many Requests Aight, level with me: Is every mastodon server running on a Raspberry Pi?
by NavinF 3y ago
> 429 Too Many Requests
Aight, level with me: Is every mastodon server running on a Raspberry Pi?
- jaeh 3y agochaos.social is run by the chaos computer club, you can assume that they configured it that way on purpose. my profile, on the same server, loads fine.
- i-am-gizm0 3y agoLooks like we hugged it to death
- colpabar 3y agoSites like HN and that other one should track this. It could work like flagging - if enough people mark it as hugged to death (HTD), it would say so next to the link. Maybe it could even redirect to an archive if it’s currently HTD.
- yieldcrv 3y agolightly blew in its general direction to death
- jeroenhd 3y agoThe server itself seems to work fine. It only seems to be this specific post that's being 429'd. I'm guessing it's some kind of anti-DDoS setup kicking in. Mastodon is also quite heavy to host, my single user instance will easily gobble up several gigabytes of memory if you let it. There are more efficient ActivityPub servers but specifically Mastodon seems to be written for running efficiently on huge servers.
- Aeolun 3y agoOr running efficiently never maybe?
- vidarh 3y agoIt will definitely "never" (barring fairly significant changes) run efficiently, you're right. It's extremely unnecessarily heavy in all kinds of ways that are made in ways that makes it run overall better on a large setup, though. All the instructions are also there to front it by proper caching, but setting it up in a proper resilient way is more effort.
- tethys 3y agoFrom the instance admins: > We just started serving a http 429 error on the exact url of the post. So everything should go back to normal now.
- chrishas35 3y agoIf you go to the user's profile and then to the post, it seems to be okay. So perhaps also looking at Referrer.
- None4U 3y agoDoing such a thing never requests to the page that is linked, so it makes sense that nothing is blocking it
- vultour 3y agoSo to answer GP's question, yes.
- isclever 3y agoMaybe, but the admin commented it was intentional for that specific post, it was slowing down the entire site.
- NavinF 3y ago> slowing down the entire site This is mind-blowing. Last I checked, the front page of HN sends tens of requests per second to each link. There are humans who can pack envelopes faster than the typical mastodon server can answer GETs. I'd love to see someone benchmark the top servers for a few seconds to see what it takes to break a reasonable latency SLA.
- bombcar 3y agoIt has been 20+ years since slashdotting with the requisite hardware and connection upgrades and still things fall over.
- fafzv 3y ago[flagged]
- crooked-v 3y agoClearly they're not microservicing hard enough.
- b33j0r 3y agoI suggest making the current team explain to 4 new teams how to port it to something fast, like elixir and rust (both!) Probably messaging with pulsar and the build system from python 4, too. I read this in a whitepaper. Let’s do this, guys! ;)
- deleted 3y ago[deleted]
- olliecornelia 3y agoAren’t federated services grand?
- mal-2 3y ago[flagged]
- neogodless 3y agoFound a similar situation, but I think the key is mostly if you're on one of those servers and seek out the content or if you're logged into one of those servers, it won't forward you (even if you click it from here, assuming same browser/container).
- mal-2 3y agoThis works from a Calckey instance, just confirmed. https://calckey.social/notes/9ebxxsy83i https://calckey.social/notes/9ebxxsy83i
- benlivengood 3y agoTo be fair, each of those is returning 429 at the time of this post.
- deleted 3y ago[deleted]
- hgsgm 3y agoTranslating, I that's only the experience for "non logged in users". Mastodon isn't meant to handle load from the the anonymous public, it's meant for a federation of servers.
- shawabawa3 3y ago> It looks like these links auto-redirect when I access them from here, but when you access them from the homeserver they are served without redirect "Works on my machine" isn't going to cut it for running a popular social network Nobodies going to go around searching for mirrors, they'll just leave and go back to twitter
- _emacsomancer_ 3y agofor the time being, archive.org has a snapshot of it: https://web.archive.org/web/20230504185520/https://chaos.social/@jonty/110307532009155432 https://web.archive.org/web/20230504185520/https://chaos.soc...
- weglasern 3y agoNot really: hhttps://leah.is/posts/scaling-the-mastodon/ https://leah.is/posts/scaling-the-mastodon/ They just got 6 times the normal requests: https://chaos.social/@ordnung/110312089838674624 https://chaos.social/@ordnung/110312089838674624
- shawabawa3 3y agounfortunately this is exactly why mastodon won't work I already don't trust mastodon links because 9 times out of 10 they simply don't work. Everyone's tiny hobby server falls over when one post gets big, and obviously not everyone is going to scale their servers to support the load of a viral post that might happen once every 6 months and will be 100x their base load
- neoromantique 3y agoMastodon is by design about small niche communities rather than centralised twitter alternative.
- rvz 3y agoThat is not the point. If someone sent any link or post that is from that Mastodon instance and it went viral, the entire instance will be sent to the ground and out for hours, making the post unavailable to be viewed. The worst part is journalists and the media have to be told that posting a link from a 'small niche community' on Mastodon will send a flood of traffic that will knock it down offline also giving the impression to others that it is not ready for mainstream at all or even ready to onboard on tens or hundreds of millions of users, daily like Twitter.
- mal-2 3y agoIt's a fair criticism but I don't feel so fatalistic. This would look a lot different if everyone was opening this post on their own home server instead of chaos.social. Unfortunately there's no way to construct a link that references the post but opens where it belongs for you. I think there needs to be a fediverse URL protocol to solve for this, ie this HN post would link to `fedi://@jonty@chaos.social/110307532009155432`, then when people clicked it they wouldn't have to talk to chaos.social, because it would be opened at their home server. Another option could be a 'copy link for public access' that generates a static page for the purpose of sharing widely. Journalists and media could also run their own server which is scaled for the traffic they expect, and mirror the post there. The main problem is linking to the source of the post instead of linking to a federated representation of it.
- neogodless 3y agoNo trouble viewing it from another Mastodon server: https://hachyderm.io/@jonty@chaos.social/110307532115312279 https://hachyderm.io/@jonty@chaos.social/110307532115312279 EDIT: Ah I guess if you're not logged into a hachyderm.io account, you get forwarded. So probably don't use the above link.
- bombcar 3y agoThat just redirected me to too many requests.
- deleted 3y ago[deleted]
- deckard1 3y agoone alt-social crumbling from throwing rocks at another alt-social This is peak Web 5.0 right here.
- jszymborski 3y agoThis post is on the front of HN. Many a larger website have succumbed to HN's warm embrace.
- yreg 3y agoIsn't HN pretty small? This post has <400 upvotes over 3 hours. There can't be 1000x that amount of lurkers can there?
- capableweb 3y agoHN has millions of page views per day (maybe @dang can give a more accurate and updated number), and things frequently gets reposted elsewhere. Happens many times that things on the frontpage gets brought down to its knees, this wouldn't be the first nor the last.
- yreg 3y agoSource on the millions? This person says they got 12k visitors over a day: https://nicklafferty.com/blog/what-happens-when-you-re-on-the-front-page-of-hacker-news/ https://nicklafferty.com/blog/what-happens-when-you-re-on-th... The websites hugged to death by this forum are usually tiny hobby projects.
- michaelsalim 3y agoNot the OP but they were referring to the whole site. So definitely not millions, but the number is probably higher than you think. From the blog you linked, the number of interest is 18k. 12k are only those with HN referrer headers. In reality, many setup strips that header so you can't track it exactly right. The author did mention they averaged 50 views before. A big part of it are reposts. From my own submissions, posting to HN resulted in tons of different origins. Public ones like reddit, twitter and private ones like newsletters, dashboard & chat messages. You'll also be surprised by the wide variety of clients people use to access HN. They also used Google analytics to track the numbers. Most people in HN block it either through the browser or an extension [0]. In reality it's probably double the traffic. Don't forget to account for scraping & crawling bots. That's another big source of traffic that the author didn't track. [0] https://plausible.io/blog/google-analytics-adblockers-missing-data#do-adblockers-stop-google-analytics https://plausible.io/blog/google-analytics-adblockers-missin...
- datadeft 3y agoBecause it is webscale.
- popey 3y agoYou can also see the same "toot" as a "tweet": https://twitter.com/jonty/status/1653915932677271552 https://twitter.com/jonty/status/1653915932677271552
- yreg 3y agoAnd the original tooter is apparently Google Translate?
- rvz 3y agoJust look at it failing the HN hug of death. If this one can't survive techies on a orange site rushing to the site then it cannot possibly survive a lotus of users from Twitter or TikTok rushing into any post on Mastodon, bringing it flat on to the floor. I can only see Mastodon centralizing to cope with the load. But a server going down on this load from HN tells us it is no where near ready to handle an insurmountable amount of users or even begin to challenge Twitter which hosts 220M+ users every single day.
- jeromegv 3y agoMastodon user count has mostly been a steady growth. So far it hasn't really failed at a high level. We aren't in Bitcoin territory, the network isn't really slower than it was a year ago even if number of user is much higher. It's mostly distributed among many instances.
- colonwqbang 3y agoTwitter is pretty sluggish, to be fair. 7 seconds to load and render a single tweet on mobile. https://pagespeed.web.dev/analysis/https-twitter-com-realDonaldTrump-status-449525268529815552/edfrfg64v6?form_factor=mobile https://pagespeed.web.dev/analysis/https-twitter-com-realDon... Mastodon.social is actually much faster on this particular benchmark. So maybe there is hope.
- heavyset_go 3y agoIronically, I've seen pages make it to the front of HN that were run on RPis or weaker. There was a guy running a site off of a single core 32bit ARM SoC that was able to handle the HN frontpage.
- jszymborski 3y agochaos.social is run on four dedicated servers https://leah.is/posts/scaling-the-mastodon/ https://leah.is/posts/scaling-the-mastodon/
- sam1r 3y agoThis was both funny and ironic at the same time. Upon clicking reply fastidiously, i got the hn 429 "Sorry, we're not able to serve your requests this quickly." Wow.