itintheory

3 ms·

1.
by itintheory 9d ago
What kind of fingerprinting are you thinking of? JA4? I haven't found a way to do that inexpensively at our scale, but we may have to go that route - looking at CloudFront bot mitigation. For behavioral, we have Anubis honeypot funct
2.
by itintheory 9d ago
This was just blocklist based. We had the main community list and a handful of the curated paid lists enabled. wrt bot detection - this sounds very much like Anubis which we're also using with some success.
3.
by itintheory 9d ago
We had the main community blocklist and several of their pricey paid blocklists enabled in a PoC capacity. We had a lot of legitimate users end up blocked. In some cases these may have been VPN exit nodes, or users on CG-NAT, or devices o
4.
by itintheory 9d ago
The basic software is open source, and the list is free if you're running the tool and contributing detections back. They do have some curated lists that you have to pay for. It's quite a bit less expensive than most other commer
5.
by itintheory 9d ago
We implemented CrowdSec for bot/scraping mitigation. The architecture is sound, but it ended up having an unacceptable false positive rate for us. This may be an issue with any kind of IP reputation approach. After a couple of month
6.
by itintheory 9d ago
Goldbacks have entered the chat. [0] [0] https://www.goldback.com/
7.
by itintheory 10d ago
The data IS available. You can download it all from several sources in one big dump. And yet we're still scraped.
8.
by itintheory 10d ago
I just finished reading a scifi book called Venemous Lumpsucker which had this type of system as a minor plot point. An interesting twist was that there were essentially smart-contract based non-disclosure agreements that could effectively
9.
by itintheory 11d ago
As someone who operates a large non-profit public data driven website, I have some VERY strong feelings about scrapers. We looked into various commercial solutions (Datadome, HUMAN) and based on our traffic estimates from logs we'd be
10.
by itintheory 12d ago
Looked into it - the bot operators also own, or are associated with, the sites that show the ads. The site showing the ads gets some percentage from Google for each click through conversion, eg app install. So app owner pays $10, google k
11.
by itintheory 14d ago
How does the bot farm profit? Did I miss it in the article somehow?
12.
by itintheory 14d ago
This is the bread and butter for commercial VPN services. The VPN knows who you are (maybe, unless you pay crypto/cash), and the rights-holders know your VPN address (from joining/logging a BitTorrent swarm, for instance), but th
13.
by itintheory 15d ago
Yeah, I really have no idea what's going on here. Maybe I too could burn some tokens to have claude explain it to me, but I won't.
14.
by itintheory 15d ago
Could you share examples?
15.
by itintheory 15d ago
Right, I'm not a fan of the ID check or identity/age verification. I'm just trying to understand the conspiracy theory kind of idea that "they're trying to get all our IDs!!!1!!" sentiment.
16.
by itintheory 15d ago
Sure, but this "invention" isn't new. It seems to make the internet rounds every few months. Here's one from 11 years ago that looks almost identical: https://www.youtube.com/watch?v=uPVQMZ4ikvM - I wo
17.
by itintheory 15d ago
Whose cause? I think the government already has our IDs, given that they issued them.
18.
by itintheory 16d ago
We have a local thrift store that sorts and stores the cables very nicely. 95% of the time I can find exactly what I need right away. That doesn't mean I don't also have my big box of cables, but just offering an alternate strate
19.
by itintheory 22d ago
Am I missing something? I get black text on a yellow background, and no apparent toggle...
20.
by itintheory 24d ago
Not sure if this counts as 'modern', but I had the unfortunate experience of driving near Seneca Meadows[1] recently. I can't begin to describe the visceral level of horrendous stench that is perpetually downwind of this fac
21.
by itintheory 24d ago
Here's a video of it in action: https://www.youtube.com/watch?v=41b8fw3_wP8
22.
by itintheory 1mo ago
I keep reading this about old.reddit.com and yet I keep using it without being logged in. It must be some kind of A/B testing or slow rollout? Or maybe it's regional?
23.
by itintheory 1mo ago
Bitwarden has lost the plot. The most recent Windows update is so bad. It has way lower information density in the UI, more buttons to click for the same use, no longer puts focus on the search field by default (this one makes me irration
24.
by itintheory 1mo ago
My understanding is that copyright of what's posted is retained by the poster. The Nitter C&D was around a ToS violation for scraping.
25.
by itintheory 1mo ago
> if it makes me sick, he will hear about it I think one of the problems of our modern food system is it can be difficult for a consumer to pinpoint the source of an infection. Food-borne illnesses can take 24-48 hrs or more to become a
26.
by itintheory 1mo ago
>the dark web I prefer the older term "deep web" [1]. It's mentioned in Wikipedia that the terms are used as synonyms now, but I think it's important to differentiate between sites behind login/authentication&#x
27.
by itintheory 1mo ago
You're blaming ... the poor?
28.
by itintheory 1mo ago
It's probably common enough to be an accepted meaning nowadays, like what's happened with "beg the question". I think the original meaning also lends itself very well to people believing the phrase is "tow the line
29.
by itintheory 1mo ago
Is the presence of an unsubscribe link a useful signal? I presume that just marks your email address as active in the spammer's database.
30.
by itintheory 1mo ago
On the other hand, it may be worth publicly and unambiguously stating a position even if unenforceable. This seems to be what most modern protest movements are based on. For instance, how many software repos "stand with Ukraine"

More ›