3 ms·
The public can still access the sites themselves.
by galleywest200 8mo ago
The public can still access the sites themselves.
- ninjagoo 8mo ago> The public can still access the sites themselves. Indefinitely? Probably not. What about when a regime wants to make the science disappear?
- pa7ch 8mo agoWhat has that got to do with blocking AI crawlers?
- ninjagoo 8mo agoIf it's publicly funded, why shouldn't AI crawlers have access to that data? Presumably those creating the AI crawlers paid taxes that paid for the science.
- JumpCrisscross 8mo ago> If it's publicly funded, why shouldn't AI crawlers have access to that data? Becase it costs money to serve them the content.
- wyre 8mo agoIf I build a business based off of consumption of publicly funded data, and that’s okay, why isn’t it okay for AI? Is the answer regulate AI? Yes.
- JumpCrisscross 8mo ago> If I build a business based off of consumption of publicly funded data, and that’s okay, why isn’t it okay for AI? Because when you build it you aren't, presumably, polling their servers every fifteen minutes for the entire corpus. AI scrapers are currently incredibly impolite.
- heavyset_go 8mo agoPlenty of public funded data isn't made free and public access. Sometimes you need to pay, or get a license, etc depending on what you're doing with it.
- 8bitsrule 8mo agoCrawlers accessing public data could be required to provide searchable access to the public data they collect. Value-for-value.
- thwarted 8mo agoSo the solution is to allow the AI scraping and hide the content, with significantly reduced fidelity and accuracy and not in the original representation, in some language model?
- mlnj 8mo agoDon't forget the onslaught of ads that will distort the actual publications even more going forward.