3 ms·

Good luck with that in Switzerland where this is 100% legal.

by seviu 3y ago

mschuster91 3y ago
Or in Germany, see §44b UrhG. [1] https://www.gesetze-im-internet.de/urhg/__44b.html https://www.gesetze-im-internet.de/urhg/__44b.html
- nmlracx 3y ago
  It seems to me that Twitter's robots.txt only allows Googlebot: https://twitter.com/robots.txt https://twitter.com/robots.txt Therefore, this disallows other bots in "maschinenlesbarer Form" and the scraping is illegal.
  - mschuster91 3y ago
    This is fascinating. Seems like at least Bing openly ignores robots.txt?
  - gnfargbl 3y ago
    Google is, to a first approximation, the web's only search engine. As such I think there's an argument to be made that declaring your bot's User-Agent as Googlebot is a technical necessity, similar to how every browser declares itself as Mozilla.
    - deleted 3y ago
      [deleted]
jauntywundrkind 3y ago
How the internet survives when basic rights conflict is the active question. 202x is the decade ever nation on the planet woke up & decided to start regulating what happens across the internet. And most of these rules don't respect anyone else's. Your people in your country do whatever you say whenever they travel across the internet afar. But those people running their servers also have their own laws that apply to them. The potential for conflict here is vast.
tzs 3y ago
They aren't alleging that it is illegal. They are alleging that it violates terms that Bright Data agreed to when Bright Data signed up for Twitter. How do website terms of service work in Switzerland, especially in the case where the person using the website has actually gone through the account creation process there?
- orwin 3y ago
  If it's like in Europe, if a contract is illegal or restrict rights disproportionately, it's unenforceable.
- martin8412 3y ago
  Much of the crap put into terms of service is null and void. It can't restrict your legal rights. As an example, they can't force you into arbitration if you want to sue them.
asdadsdad 3y ago
interesting point. in which countries that would be 100% legal in general? BrightData is set up in Israel, right? Is that the case there? But I wonder if having a US entity (NY) they are bound to US jurisdiction for this. Also, what does that mean for all tooling that scrapes/d Twitter?

Good luck with that in Switzerland where this is 100% legal.

by seviu 3y ago

Good luck with that in Switzerland where this is 100% legal.

Or in Germany, see §44b UrhG. [1] https://www.gesetze-im-internet.de/urhg/__44b.html https://www.gesetze-im-internet.de/urhg/__44b.html

nmlracx 3y ago
It seems to me that Twitter's robots.txt only allows Googlebot: https://twitter.com/robots.txt https://twitter.com/robots.txt Therefore, this disallows other bots in "maschinenlesbarer Form" and the scraping is illegal.
- mschuster91 3y ago
  This is fascinating. Seems like at least Bing openly ignores robots.txt?
- gnfargbl 3y ago
  Google is, to a first approximation, the web's only search engine. As such I think there's an argument to be made that declaring your bot's User-Agent as Googlebot is a technical necessity, similar to how every browser declares itself as Mozilla.
  - deleted 3y ago
    [deleted]

jauntywundrkind 3y ago

How the internet survives when basic rights conflict is the active question. 202x is the decade ever nation on the planet woke up & decided to start regulating what happens across the internet. And most of these rules don't respect anyone else's. Your people in your country do whatever you say whenever they travel across the internet afar. But those people running their servers also have their own laws that apply to them. The potential for conflict here is vast.

tzs 3y ago

They aren't alleging that it is illegal. They are alleging that it violates terms that Bright Data agreed to when Bright Data signed up for Twitter. How do website terms of service work in Switzerland, especially in the case where the person using the website has actually gone through the account creation process there?

orwin 3y ago
If it's like in Europe, if a contract is illegal or restrict rights disproportionately, it's unenforceable.
martin8412 3y ago
Much of the crap put into terms of service is null and void. It can't restrict your legal rights. As an example, they can't force you into arbitration if you want to sue them.

asdadsdad 3y ago

interesting point. in which countries that would be 100% legal in general? BrightData is set up in Israel, right? Is that the case there? But I wonder if having a US entity (NY) they are bound to US jurisdiction for this. Also, what does that mean for all tooling that scrapes/d Twitter?