2 ms·

Anything significantly more complicated than CRUD apps like HN is pretty rare on the web. If the resource usage of a website is a concern, either your code is

Anything significantly more complicated than CRUD apps like HN is pretty rare on the web. If the resource usage of a website is a concern, either your code is straight up broken or you're doing something rather unusual. While doing unusual things, it's normal to encounter unusual problems. However, when encountering an unusual problem it's good to stop for a moment and consider if your approach is wrong. At some point the only good way to stop scraping becomes paywalls. You can't defeat sophisticated scrapers through any other means.

spiderfarmer 9mo ago
So you’re blaming the destruction of the open internet on the technical prowess of indie developers like me and not on the greedy big tech leeches with thousands of mindless developers who do everything in their power to make life worse for the little guys.
- JasonADrury 9mo ago
  I don't think the open internet is being destroyed at all. This is just the usual complaining about internet background noise that's been happening for decades. Is there more background noise than before? Yes, probably. Is it a big deal yet? Still not.
  - bigbadfeline 9mo ago
    > Yes, probably. Is it a big deal yet? Still not. "Trust me bro, not a big deal... YET, pay up and move along, nothing to see here" That might be true for you, but it definitely isn't true for everybody, if you don't want to stop bots, nobody is stopping you from not stopping them, but you keep arguing as if your life depends on it... Are you a bot too? Who in his right mind would wait for some problem to become a really big deal without seeking a way to prevent it?
    - JasonADrury 9mo ago
      > That might be true for you, but it definitely isn't true for everybody, if you don't want to stop bots, nobody is stopping you from not stopping them, but you keep arguing as if your life depends on it... Are you a bot too? Feel free to "stop the bots", it just probably isn't a sensible use of your time. >Who in his right mind would wait for some problem to become a really big deal without seeking a way to prevent it? You're starting from the huge assumption that this will ever become a big deal.

spiderfarmer 9mo ago

So you’re blaming the destruction of the open internet on the technical prowess of indie developers like me and not on the greedy big tech leeches with thousands of mindless developers who do everything in their power to make life worse for the little guys.

JasonADrury 9mo ago
I don't think the open internet is being destroyed at all. This is just the usual complaining about internet background noise that's been happening for decades. Is there more background noise than before? Yes, probably. Is it a big deal yet? Still not.
- bigbadfeline 9mo ago
  > Yes, probably. Is it a big deal yet? Still not. "Trust me bro, not a big deal... YET, pay up and move along, nothing to see here" That might be true for you, but it definitely isn't true for everybody, if you don't want to stop bots, nobody is stopping you from not stopping them, but you keep arguing as if your life depends on it... Are you a bot too? Who in his right mind would wait for some problem to become a really big deal without seeking a way to prevent it?
  - JasonADrury 9mo ago
    > That might be true for you, but it definitely isn't true for everybody, if you don't want to stop bots, nobody is stopping you from not stopping them, but you keep arguing as if your life depends on it... Are you a bot too? Feel free to "stop the bots", it just probably isn't a sensible use of your time. >Who in his right mind would wait for some problem to become a really big deal without seeking a way to prevent it? You're starting from the huge assumption that this will ever become a big deal.