4 ms·

Does this mean it's now possible to write plugins that dismiss cookie popups, solve captchas, scroll web pages etc.?

nikisweeting 2y ago
I have a private plugin with puppeteer support for stuff like this, currently charging clients money to use it to fund the open source development. The clients are people who are already legally allowed to evade CAPTCHAS (e.g. governments, NGOs doing research, lawyers collecting evidence, etc.) Unfortunatley I cant open source the CAPTCHA solving stuff myself, because it opens me up to liability, but if someone wants to contribute a plugin to the ecosystem I cant stop them ;).
- 0x1ch 2y ago
  Legally allowed to evade CAPTCHAs? LOL. What world do we live in where evading a captcha is an illegal offense?
  - nikisweeting 2y ago
    It doesn't matter whether or not it's actually legal, what matters is that the big platforms will sue you for trying, so you need a big bankroll to stand your ground. At the very least they can bar you from accessing their sites as you're violating ToS that you accept upon signup.
- pbronez 2y ago
  That’s a pretty savvy open-core strategy: paywall features that create risk of legal liability so they are only used when there’s a paying customer/operator to assume that risk.
xiconfjs 2y ago
You mean ArchiveBox still doesn’t deal with cookie popups? If so, it’s quasi not useful for EU based web sites.
- nikisweeting 2y ago
  It does, you just have to set up a chrome profile that has an extension to hide cookie popups, or use a profile where you've already accepted/closed them and have a session. You can archive with any chrome profile with arbitrary extensions enabled, so you can use uBlock, I still Don't care about cookies, Ghostery, etc.
  - ajvs 2y ago
    How do you set this up? I found this relevant issue[1] but it doesn't explain how to get it working. [1] https://github.com/ArchiveBox/ArchiveBox/issues/211 https://github.com/ArchiveBox/ArchiveBox/issues/211
    - nikisweeting 2y ago
      https://github.com/ArchiveBox/ArchiveBox/wiki/Chromium-Install#setting-up-a-chromium-user-profile https://github.com/ArchiveBox/ArchiveBox/wiki/Chromium-Insta... https://github.com/ArchiveBox/ArchiveBox/wiki/Configuration/#chrome_user_data_dir https://github.com/ArchiveBox/ArchiveBox/wiki/Configuration/... https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overview#archiving-content-behind-log-ins--advanced-users-only https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overv...

I have a private plugin with puppeteer support for stuff like this, currently charging clients money to use it to fund the open source development. The clients are people who are already legally allowed to evade CAPTCHAS (e.g. governments, NGOs doing research, lawyers collecting evidence, etc.) Unfortunatley I cant open source the CAPTCHA solving stuff myself, because it opens me up to liability, but if someone wants to contribute a plugin to the ecosystem I cant stop them ;).

0x1ch 2y ago
Legally allowed to evade CAPTCHAs? LOL. What world do we live in where evading a captcha is an illegal offense?
- nikisweeting 2y ago
  It doesn't matter whether or not it's actually legal, what matters is that the big platforms will sue you for trying, so you need a big bankroll to stand your ground. At the very least they can bar you from accessing their sites as you're violating ToS that you accept upon signup.
pbronez 2y ago
That’s a pretty savvy open-core strategy: paywall features that create risk of legal liability so they are only used when there’s a paying customer/operator to assume that risk.

xiconfjs 2y ago

You mean ArchiveBox still doesn’t deal with cookie popups? If so, it’s quasi not useful for EU based web sites.

nikisweeting 2y ago
It does, you just have to set up a chrome profile that has an extension to hide cookie popups, or use a profile where you've already accepted/closed them and have a session. You can archive with any chrome profile with arbitrary extensions enabled, so you can use uBlock, I still Don't care about cookies, Ghostery, etc.
- ajvs 2y ago
  How do you set this up? I found this relevant issue[1] but it doesn't explain how to get it working. [1] https://github.com/ArchiveBox/ArchiveBox/issues/211 https://github.com/ArchiveBox/ArchiveBox/issues/211
  - nikisweeting 2y ago
    https://github.com/ArchiveBox/ArchiveBox/wiki/Chromium-Install#setting-up-a-chromium-user-profile https://github.com/ArchiveBox/ArchiveBox/wiki/Chromium-Insta... https://github.com/ArchiveBox/ArchiveBox/wiki/Configuration/#chrome_user_data_dir https://github.com/ArchiveBox/ArchiveBox/wiki/Configuration/... https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overview#archiving-content-behind-log-ins--advanced-users-only https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overv...