2 ms·
While the APIs make it significantly easier to ingest for LLM training, scraping will still work. Unless they put 100% of content behind a login-gate, it's cur
by celestialcheese 3y ago
While the APIs make it significantly easier to ingest for LLM training, scraping will still work.
Unless they put 100% of content behind a login-gate, it's currently legal* to scrape and use for derivative works, as long as you have the money and the chutzpah to deal with lawsuits that may or may not come.
- https://blog.ericgoldman.org/archives/2022/12/hello-youve-been-referred-here-because-youre-wrong-about-web-scraping-laws-guest-blog-post-part-2-of-2.htm https://blog.ericgoldman.org/archives/2022/12/hello-youve-be...