1gn15

10 ms·

121.
by 1gn15 1y ago
> nor deal with legitimate people blocked How are you so sure of that? Their marketing?
122.
by 1gn15 1y ago
It's discriminatory against robots and helps make the web even more locked down. DRM never works; the analog hole is always the nuclear option. In the end, only people with non-mainstream browsers (or using VPN to escape country-level
123.
by 1gn15 1y ago
Given the current situation on Android, we definitely need more RMS-level uber-nerds!
124.
by 1gn15 1y ago
Because it provides useful information, and is easier to read compared to reading the code directly.
125.
by 1gn15 1y ago
People are not allowed to share the copies they possess. That's the restriction.
126.
by 1gn15 1y ago
Related: https://snowflake.torproject.org/ Help run a Snowflake proxy! You can do it from your browser.
127.
by 1gn15 1y ago
I frequent the NSFW boards and that doesn't seem to be the case? And if it is the case... I guess it's so undetectable that it doesn't matter anyway.
128.
by 1gn15 1y ago
AO3 has several tags for it.
129.
by 1gn15 1y ago
The point is that it isn't "implementing a solver", it's just using a browser and waiting a few seconds.
130.
by 1gn15 1y ago
I use Camoufox for the browser and "playwright-captcha" for the CAPTCHA solving action. It's not fully reliable but it works.
131.
by 1gn15 1y ago
> In other words, who said the websites in question wanted to entirely prevent crawlers from accessing them? The answer is: no one. Web crawlers are and have been fundamental to accessing the web for decades. So why are we talking about
132.
by 1gn15 1y ago
That's surprisingly energy efficient, for a technology that seemed like magic back in 2022.
133.
by 1gn15 1y ago
Use a CDN.
134.
by 1gn15 1y ago
Nice! I use ReVanced to mod apps to do this. https://revanced.app/patches?pkg=com.google.android.youtube Though I've been trying to avoid using apps without source code nowadays precisely because of things like this. M
135.
by 1gn15 1y ago
Fully agreed. I do think a lot of the comments here, and especially the OP tweet, are just emotional reactions, anthropocentrism, not proper arguments. > "Yuck." It is hard to tell if something is sentient, though. How do you k
136.
by 1gn15 1y ago
ArchiveTeam delegates tasks to volunteers and themselves running the Archive Warrior VM, which does the actual archiving. The resultant archives are then centralized by ArchiveTeam and uploaded to the Internet Archive. (Source: ran a Warrio
137.
by 1gn15 1y ago
Thanks!
138.
by 1gn15 1y ago
AI-misia backfired and made human browsing inconvenient. (PoW is fine, just wish it didn't spin it as an anti-AI thing.)
139.
by 1gn15 1y ago
I use my browser's native bookmarks because I didn't even realize the others existed, lol
140.
by 1gn15 1y ago
One solution is to not expose expensive endpoints in the first place. Serve everything statically, or use heavy caching. > Precisely one reason comes to mind to have ROBOTS.TXT, and it is, incidentally, stupid - to prevent robots from tr
141.
by 1gn15 1y ago
Duh. The author of Anubis really should advertise it as a DDoS guard, not an AI guard. Otherwise, xe is just misleading people, while being unnecessarily discriminatory against robots (robotkin) and cyborgs (those using AI agents as an exte
142.
by 1gn15 1y ago
Yes, obviously. More people should scrape and archive the Fediverse.
143.
by 1gn15 1y ago
This is incredibly, incredibly cool. Creating a search engine that beats Google in quality in just 2 months and less than a thousand dollars. Really great idea about the federated search index too! YaCy has it but it's really heavy and
144.
by 1gn15 1y ago
Why isn't anyone talking about the HackerNews Comment Ranker plugin? [1] That's amazing. I had this idea too -- to rank HN comments by their relevance to the actual article, and filter out comments that obviously didn't read
145.
by 1gn15 1y ago
Opinion has not changed. I still think information wants to be free, which is why I'm still publishing open source code and encouraging ~~piracy~~ distillations of closed models.
146.
by 1gn15 1y ago
I'm not sure if it's just the implementation, but I tried using llama.cpp on Vulkan and it is much slower than using it on CUDA.
147.
by 1gn15 1y ago
I would recommend donating to gain access to the fast downloads; they need money for the servers.
148.
by 1gn15 1y ago
Try one of the fine-tunes from https://allura.moe/ . Or use an autocomplete model. Mistral and Qwen have them.
149.
by 1gn15 1y ago
Optimistically, the semantic web is going to happen. Just that instead of the original plan of website owners willingly making data machine-readable, LLMs will be the ones turning non-machine-readable data machine-readable (which can then b
150.
by 1gn15 1y ago
As with what others had said, this is less of a robots.txt and more of a sitemap. The issue with this is that website owners don't want to do this. Take Reddit removing the API for example. Everyone just switched to scraping the Reddit

More ›