xena

13 ms·

241.
by xena 1y ago
You should, because universities are starting to get legal involved due to mass scraping taking down their systems.
242.
by xena 1y ago
Do you respect robots.txt?
243.
I fight bots in my free time(xeiaso.net)
8 points by xena 1y ago|0 comments
244.
by xena 1y ago
You set up the environment to create more people like you the same way those experienced people did. I've found that mentorship like this has been one of the most rewarding things I've ever done in my career.
245.
by xena 1y ago
Does not load in Firefox
246.
by xena 1y ago
Next release will have a no-JS check: https://anubis.techaro.lol/docs/admin/configuration/challeng...
247.
by xena 1y ago
Do you happen to have a dual-stack network?
248.
by xena 1y ago
Anubis author here. I have been working on a no-js approach. I just have to be careful so that the scrapers don't just implement it and bypass it forever.
249.
Fending off scrapers with Tigris and DuckDB(tigrisdata.com)
3 points by xena 1y ago|0 comments
250.
by xena 1y ago
Anubis author here. Tell me what I'm missing to implement protein folding without having to download gigabytes of scientific data to random people's browsers and I'll implement it today.
251.
by xena 1y ago
Thanks! I'm gonna try and bootstrap this into a company. My product goal for the immediate future is unbranded Anubis (already implemented) with a longer term goal of being a Canadian-run Cloudflare competitor.
252.
by xena 1y ago
I've set up a few honeypot servers. Right now OpenAI alone accounts for 4 hours of compute for one of the honeypots in a span of 24 hours. It's not hypothetical.
253.
by xena 1y ago
Anubis author here. I looked into protein folding. The problem is that protein folding requires scientific data, which can easily get into the gigabyte range. That is more data than I want to serve to clients. Unless there's a way to s
254.
by xena 1y ago
Honestly it's not been worth my time. I spent more time shoving things into Nix than I did shipping.
255.
by xena 1y ago
I'm actively seeking jobs that don't have me deal with AI. It's a rough market out there because I want to go counter to the hype.
256.
by xena 1y ago
404
257.
by xena 1y ago
The abuse they're talking about is more like "incurring too much AI spend". Anubis won't help with that.
258.
by xena 1y ago
Do you store cookies?
259.
by xena 1y ago
I just used them today to sort a list of browser releases by their publication date. They're not universal hammers but sometimes you do encounter something nail shaped that they're great at.
260.
Anubis and Caddy-Docker-Proxy(patdavid.net)
2 points by xena 1y ago|0 comments
261.
Updated rate limits for unauthenticated requests(github.blog)
108 points by xena 1y ago|177 comments
262.
by xena 1y ago
Do you respect robots.txt? How can I block your crawlers?
263.
by xena 1y ago
Why should I bother to read something you didn't bother to write?
264.
by xena 1y ago
I just want you to know that this has crossed something off of my satirical fiction list because now it is too real.
265.
by xena 1y ago
I will for my typical hourly rate plus the consulting bonus.
266.
by xena 1y ago
How do I block your service? Do you read robots.txt and have an identifiable user agent?
267.
by xena 1y ago
Caches would only work if the bots were hitting routes that any human had ever hit before.
268.
by xena 1y ago
The pro gamer move is to use risk calculation as a means of determining when to throw a challenge, not when to deny access :)
269.
by xena 1y ago
Thanks! I'm going out of my way to make sure smaller browsers like Pale Moon aren't locked out when I add reputation into the equation. One of my prototypes that would work in concert with other changes works in links too :)
270.
by xena 1y ago
I have plans involving IP reputation and a few other behaviors I've noticed. The main problem is that all my ideas involve cookies.

More ›