4 ms·

I almost kinda didn't bother because of the cloudflare DDoS protection. I know that can be petty, but I wouldn't have waited if it was from a Google results pag

I almost kinda didn't bother because of the cloudflare DDoS protection. I know that can be petty, but I wouldn't have waited if it was from a Google results page for example.

marginalia_nu 5y ago
I just turned it up a notch right now for a moment, a lot of people are really aggressively bot-scraping new HN submissions for whatever reason. It's like a minor DoS every time you submit a link. That's fine for a blog I guess, but this I perform a non-trivial calculation for each request, so I'd rather not have bot spam. (This is hosted on a computer in my living room, so I can't just scale it up)
- Nextgrid 5y ago
  > I perform a non-trivial calculation for each request Any reason why caching wouldn't work here? Do the results have to be different on each request instead of being cached for a short while (10 seconds)?
  - marginalia_nu 5y ago
    Oh yeah, you could probably do some sort of caching to that effect. This is just a fun toy I hacked together, so it's not super optimized.
- was_a_dev 5y ago
  I mean fair enough. I gave you the time since I came from HN and knew the risk/reward for good content was strong. If it was more than a toy, it would need to be less aggresive
- kreeben 5y ago
  >> This is hosted on a computer in my living room Since you serve Swedish weather info from marginalia I'm assuming you live in Sweden, is that correct? Could you very briefly explain how you host and serve pages from your living room and what your bandwidth is? Does your ISP get cranky when you see DOS type of traffic? I'm a fellow hobbyist search engine dev, also from Sweden. Whenever I demonstrate my search engine by hosting in the cloud the expenses get so big I have to go offline after a short while and I've therefore been contemplating personal, living room hosting.
  - marginalia_nu 5y ago
    > Since you serve Swedish weather info from marginalia I'm assuming you live in Sweden, is that correct? It is indeed. > Could you very briefly explain how you host and serve pages from your living room and what your bandwidth is? 100/100 mbit municipal broadband, through Bahnhof. > Does your ISP get cranky when you see DOS type of traffic? Haven't heard a word form them, although you'd be surprised how far I am from saturating my line. Your average bittorrent enthusiast probably uses a lot more. I do try to not be a nuisance though. Cloudflare helps take the edge off things, as does running a local DNS cache. > I'm a fellow hobbyist search engine dev, also from Sweden. Whenever I demonstrate my search engine by hosting in the cloud the expenses get so big I have to go offline after a short while and I've therefore been contemplating personal, living room hosting. You might also consider server rental. Can get away with SEK 2-4k/month. My server, including UPS and other expenses is like SEK 40k, plus I expect to burn through an SSD once a year or so.
    - kreeben 5y ago
      Very helpful, thank you. Which part of Sweden are you in, by the way.
      - marginalia_nu 5y ago
        Up north.

I almost kinda didn't bother because of the cloudflare DDoS protection. I know that can be petty, but I wouldn't have waited if it was from a Google results page for example.

marginalia_nu 5y ago

I just turned it up a notch right now for a moment, a lot of people are really aggressively bot-scraping new HN submissions for whatever reason. It's like a minor DoS every time you submit a link. That's fine for a blog I guess, but this I perform a non-trivial calculation for each request, so I'd rather not have bot spam. (This is hosted on a computer in my living room, so I can't just scale it up)

Nextgrid 5y ago
> I perform a non-trivial calculation for each request Any reason why caching wouldn't work here? Do the results have to be different on each request instead of being cached for a short while (10 seconds)?
- marginalia_nu 5y ago
  Oh yeah, you could probably do some sort of caching to that effect. This is just a fun toy I hacked together, so it's not super optimized.
was_a_dev 5y ago
I mean fair enough. I gave you the time since I came from HN and knew the risk/reward for good content was strong. If it was more than a toy, it would need to be less aggresive
kreeben 5y ago
>> This is hosted on a computer in my living room Since you serve Swedish weather info from marginalia I'm assuming you live in Sweden, is that correct? Could you very briefly explain how you host and serve pages from your living room and what your bandwidth is? Does your ISP get cranky when you see DOS type of traffic? I'm a fellow hobbyist search engine dev, also from Sweden. Whenever I demonstrate my search engine by hosting in the cloud the expenses get so big I have to go offline after a short while and I've therefore been contemplating personal, living room hosting.
- marginalia_nu 5y ago
  > Since you serve Swedish weather info from marginalia I'm assuming you live in Sweden, is that correct? It is indeed. > Could you very briefly explain how you host and serve pages from your living room and what your bandwidth is? 100/100 mbit municipal broadband, through Bahnhof. > Does your ISP get cranky when you see DOS type of traffic? Haven't heard a word form them, although you'd be surprised how far I am from saturating my line. Your average bittorrent enthusiast probably uses a lot more. I do try to not be a nuisance though. Cloudflare helps take the edge off things, as does running a local DNS cache. > I'm a fellow hobbyist search engine dev, also from Sweden. Whenever I demonstrate my search engine by hosting in the cloud the expenses get so big I have to go offline after a short while and I've therefore been contemplating personal, living room hosting. You might also consider server rental. Can get away with SEK 2-4k/month. My server, including UPS and other expenses is like SEK 40k, plus I expect to burn through an SSD once a year or so.
  - kreeben 5y ago
    Very helpful, thank you. Which part of Sweden are you in, by the way.
    - marginalia_nu 5y ago
      Up north.