xena

13 ms·

1. 271.▲
   by xena 1y ago

   Hi. Developer of Anubis here. How am I meant to store state in the client without cookies if JavaScript is also disabled? Genuinely curious.
2. 272.▲
   by xena 1y ago

   I think the project is now mature enough for i18n, I've been putting it off because adding it ossifies a lot of the design but I think it's ready now.
3. 273.▲
   by xena 1y ago

   Thanks! I'll be sure to post through it either way. My failure condition is going back to work somewhere else, so worst case it'll be more likely to happen :) Really though my dayjob kinda burns me out because I have to focus on A
4. 274.▲
   by xena 1y ago

   To be fair, I'm not angry, I just think they're a coward because the UN kept the anime mascot intact. https://policytoolbox.iiep.unesco.org/ I even it out by how I prioritize feature requests, bug reports, and the
5. 275.▲
   by xena 1y ago

   Thanks! There's a lot of really hard problems to solve and most of them hinge around trust. I usually default into solving trust by making things open, but security software needs a bit of cloak and dagger by necessity. I'll find
6. 276.▲
   by xena 1y ago

   Shitty heuristics buy time to gather data and make better heuristics.
7. 277.▲
   by xena 1y ago

   Hit me up at https://xeiaso.net/contact , more than willing to talk :)
8. 278.▲
   by xena 1y ago

   I'd be happy to talk about it if it existed, I'm still working out the details. But the basic idea is to take advantage of the fact that Anubis is a very popular project from what I've seen with logs that server admin have su
9. 279.▲
   by xena 1y ago

   I am actually working on changing functionality for paid customers, it's just access to a bigger database of default rules and IP reputation tracking.
10. 280.▲
    by xena 1y ago

    I've soft launched the commercial offering and I'm working on expanding the commercial features before I announce it more publicly. If you pay $50 a month on GitHub sponsors, you get access to BotStopper complete with custom CSS s
11. 281.▲
    by xena 1y ago

    You're seeing an experiment in progress. It seems to be working, but I have yet to get enough data to know if it's ultimately successful or not.
12. 282.▲
    by xena 1y ago

    I did actually try zip bombs at first. They didn't work due to the architecture of how Amazon's scraper works. It just made the requests get retried.
13. 283.▲
    by xena 1y ago

    I'm working on making Anubis way less aggressive so that it only challenges the worst of the bad bots. I found a pattern that the bots can't fake client side and I've turned that into a sample rule that I've deployed to
14. 284.▲
    Ask HN: Is there a decent configuration format?

    7 points by xena 1y ago|1 comments
15. 285.▲
    by xena 1y ago

    Write a regular expression that matches Miqo'te seekers of the sun names. They always confuse the male and female naming conventions.
16. 286.▲
    by xena 1y ago

    How do I block it from my services? Does it obey robots.txt?
17. 287.▲
    by xena 1y ago

    Most scrapers don't run browsers. Making the scrapers run real browsers changes the economics of scraping and makes it less cost-effective. I am working on making it allow more traffic by default and then applying challenges based on r
18. 288.▲
    by xena 1y ago

    I have NLNet on the TODO list, I just haven't had time for it yet :(
19. 289.▲
    by xena 2y ago

    Her* It was frustration at AWS' Alexa team and their abuse of the commons. Amusingly if they had replied to my email before I wrote my shitpost of an implementation this all could have turned out vastly differently.
20. 290.▲
    Crawler operators, please stop destroying the commons(lunnova.dev)

    7 points by xena 2y ago|0 comments
21. 291.▲
    by xena 2y ago

    I can claim that my car is able to fly. That does not mean pressing the gas pedal makes it generate lift.
22. 292.▲
    by xena 2y ago

    Patches are welcome!
23. 293.▲
    by xena 2y ago

    This looks like a marine biologist desperately wanted to keep their job in spite of the "nothing that's not AI" mandate so they made up some bullshit.
24. 294.▲
    by xena 2y ago

    Xe here. If I had to guess in two words: timing and luck. As the G-man said: the right man in the wrong place can make all the difference in the world. I was the right shitposter in the right place at the right time. And then the universe b
25. 295.▲
    by xena 2y ago

    Honestly it's a fair assumption on bot filtering software that no more than like 8 people will share an IPv4. This is going to make IP reputation solutions hard. Argh.
26. 296.▲
    by xena 2y ago

    It will be sooner if I can get paid enough to be able to quit my day job.
27. 297.▲
    by xena 2y ago

    You mean with the art assets extracted? $ mkdir -p ./tmp/anubis/static && anubis --extract-resources=./tmp/anubis/static
28. 298.▲
    by xena 2y ago

    I'm considering making it come back, but it's just gotten me too much abuse so I'm probably gonna leave it 404-ing until society is better.
29. 299.▲
    by xena 2y ago

    Apparently user-agent switchers don't work for fetch() requests, which means that Anubis can't work with people that do that. I know of someone that set up a version of brave from 2022 with a user-agent saying it's chrome 150
30. 300.▲
    by xena 2y ago

    Main author of Anubis here: Basically what they said. This is a hack, and it's specifically designed to exploit the infrastructure behind industrial-scale scraping. They usually have a different IP address do the scraping for each page