4 ms·
I do kind of yern for the simpler days when if a website didn't mind bots it allowed it and if they did they blocked your user agent.
by matt-p 2y ago
I do kind of yern for the simpler days when if a website didn't mind bots it allowed it and if they did they blocked your user agent.
- andrethegiant 2y agoBack then websites weren’t so resource intensive. The negative backlash towards bots is kind of a side effect of how demanding expectations of web experiences has become.
- thunderfork 2y ago[dead]