3 ms·
Avoiding captchas and disrespecting robots.txt. How does it feel to advertise your spam service? Are you proud?
by Disposal8433 1y ago
Avoiding captchas and disrespecting robots.txt. How does it feel to advertise your spam service? Are you proud?
- AlexeyBelov 1y agoThe pricing page was higher in priority
- ogandreakiro 1y agoWe added the pricing breakdown here: https://www.notte.cc/#pricing https://www.notte.cc/#pricing
- ogandreakiro 1y agoHey- we built Notte for legitimate workflows like testing and approved automation; not abuse. Like other session provider tools (Browserbase, Hyperbrowser, Anchor, etc.), we encourage respecting site terms and robots.txt, and we’re adding built-in support for it soon to enforce this policy inside Notte.
- xena 1y agoYou should also support Web Bot Auth and make it required to have a customer-specific abuse contact in the user-agent header so that people can send invoices to those customers for when your customers cause downtime due to excessive scraping.
- ogandreakiro 1y agoYes, that’s a very good point! We’ll look into this for SDK usage. What do you recommend for the public repo where it's harder to enforce runtime headers?
- xena 1y agoNo compliance? No support.