3 ms·
Users of non-mainstream browsers are now being required solve CAPTCHAs.^1 If hitting the Cloudflare CAPTCHA for HTML results, it appears JSON results are still
by 1vuio0pswjnm7 5y ago
Users of non-mainstream browsers are now being required solve CAPTCHAs.^1 If hitting the Cloudflare CAPTCHA for HTML results, it appears JSON results are still available. Rate limit unpublished.
curl https://api.marginalia.nu/public/example.com
1. Or users of mainstream browsers that turn off Javascript. Yikes.
Hope the author finds a new job that satisfies his requirements. Maybe he will get some help from fans of marginalia.nu.
It was nice to see an on premises, non-commercial search engine project. Proof of what's possible and the quality of results that can be achieved on a relatively small budget.
- marginalia_nu 5y agoThe CAPTCHAS should be limited to only some IP ranges, I saw a spike in botspam a while back and had to dial up the bot mitigation a bit to be able to maintain service. Will reduce it when they give up.
- sundarurfriend 5y agoWhat do bots do with a search engine? I understand botspam on the content side where they just generate keyword-"rich" pages trying for SEO, but it sounds like they're running searches on your search engine in this case, and I don't understand the purpose of that.
- marginalia_nu 5y agoI'm honestly not entirely sure what they are trying to do. My best guess is possibly it's an attempt at manipulating a suggestions algorithm, but I don't even persist query data so it's a bit of a waste. But maybe they think I'm backed by Google or Bing?