3 ms·
> If Marginalia Search didn't use Cloudflare, it couldn't serve traffic. There has been upwards of 15 queries per second from bots. 15 RPS is very far from an
by golergka 4y ago
> If Marginalia Search didn't use Cloudflare, it couldn't serve traffic. There has been upwards of 15 queries per second from bots.
15 RPS is very far from an apocalypse.
- deleted 4y ago[deleted]
- Avamander 4y agoIt's bad if it's your dead-average Wordpress site that has 10 PHP workers, each page load being >1s. Easy DoS.
- Aachen 4y agoYeah but WordPress is an extreme example. Every time a WP blog is posted to HN without a static-page-ifier (caching layer that basically turns the dynamic pages into static ones), it dies within minutes. Normal software doesn't seem to have that problem. I traced it once, and I got to admit there was not an obvious bottleneck (this was 2015 or so). Just millions upon millions of calls into deeper and deeper layers for things like translations or themes. Wrapping mysql_query in a function that caches the result (to avoid doing identical queries) helped a few % I think, but aside from major changes like patching out the entire translation system for single-language sites, I didn't spot an obvious way to fix it. You'd need to spend a lot of time to optimize away the complexity that grew from suiting a million different needs, contributed by thousands of people across many years.
- marginalia_nu 4y agoIt is if you're hosting an internet search engine on a PC.
- deleted 4y ago[deleted]
- golergka 4y agoWhy would you do such a thing in the first place?
- marginalia_nu 4y agoBecause I want this search engine to exist, and I'm not a multimillionaire so I can't afford better hardware. See, when it comes to not being able to find stuff on Google, you can either complain about it on the internet, or you can build a search engine yourself that allows you to find what you are looking for. I chose the second option.