4 ms·

> I suppose some big science publishers are blocking AI bots too. That's a travesty, considering that a huge chunk of science is public-funded; the public is b

> I suppose some big science publishers are blocking AI bots too. That's a travesty, considering that a huge chunk of science is public-funded; the public is being denied the benefits of what they're paying for, essentially.

galleywest200 9mo ago
The public can still access the sites themselves.
- ninjagoo 9mo ago
  > The public can still access the sites themselves. Indefinitely? Probably not. What about when a regime wants to make the science disappear?
  - pa7ch 9mo ago
    What has that got to do with blocking AI crawlers?
    - ninjagoo 9mo ago
      If it's publicly funded, why shouldn't AI crawlers have access to that data? Presumably those creating the AI crawlers paid taxes that paid for the science.
      - JumpCrisscross 9mo ago
        > If it's publicly funded, why shouldn't AI crawlers have access to that data? Becase it costs money to serve them the content.
        wyre 9mo ago
        If I build a business based off of consumption of publicly funded data, and that’s okay, why isn’t it okay for AI? Is the answer regulate AI? Yes.
        JumpCrisscross 9mo ago
        > If I build a business based off of consumption of publicly funded data, and that’s okay, why isn’t it okay for AI? Because when you build it you aren't, presumably, polling their servers every fifteen minutes for the entire corpus. AI scrapers are currently incredibly impolite.
        heavyset_go 9mo ago
        Plenty of public funded data isn't made free and public access. Sometimes you need to pay, or get a license, etc depending on what you're doing with it.
        8bitsrule 9mo ago
        Crawlers accessing public data could be required to provide searchable access to the public data they collect. Value-for-value.
  - thwarted 9mo ago
    So the solution is to allow the AI scraping and hide the content, with significantly reduced fidelity and accuracy and not in the original representation, in some language model?
    - mlnj 9mo ago
      Don't forget the onslaught of ads that will distort the actual publications even more going forward.

galleywest200 9mo ago

The public can still access the sites themselves.

ninjagoo 9mo ago
> The public can still access the sites themselves. Indefinitely? Probably not. What about when a regime wants to make the science disappear?
- pa7ch 9mo ago
  What has that got to do with blocking AI crawlers?
  - ninjagoo 9mo ago
    If it's publicly funded, why shouldn't AI crawlers have access to that data? Presumably those creating the AI crawlers paid taxes that paid for the science.
    - JumpCrisscross 9mo ago
      > If it's publicly funded, why shouldn't AI crawlers have access to that data? Becase it costs money to serve them the content.
      - wyre 9mo ago
        If I build a business based off of consumption of publicly funded data, and that’s okay, why isn’t it okay for AI? Is the answer regulate AI? Yes.
        JumpCrisscross 9mo ago
        > If I build a business based off of consumption of publicly funded data, and that’s okay, why isn’t it okay for AI? Because when you build it you aren't, presumably, polling their servers every fifteen minutes for the entire corpus. AI scrapers are currently incredibly impolite.
        heavyset_go 9mo ago
        Plenty of public funded data isn't made free and public access. Sometimes you need to pay, or get a license, etc depending on what you're doing with it.
      - 8bitsrule 9mo ago
        Crawlers accessing public data could be required to provide searchable access to the public data they collect. Value-for-value.
- thwarted 9mo ago
  So the solution is to allow the AI scraping and hide the content, with significantly reduced fidelity and accuracy and not in the original representation, in some language model?
  - mlnj 9mo ago
    Don't forget the onslaught of ads that will distort the actual publications even more going forward.