4 ms·
The SQLite team faced a similar problem last year, and Richard Hipp (the creator of SQLite) made almost the same comment: "The malefactor behind this attack co
by randyl 9mo ago
The SQLite team faced a similar problem last year, and Richard Hipp (the creator of SQLite) made almost the same comment:
"The malefactor behind this attack could just clone the whole SQLite source repository and search all the content on his own machine, at his leisure. But no: Being evil, the culprit feels compelled to ruin it for everyone else. This is why you don't get to keep nice things...."
https://sqlite.org/forum/forumpost/7d3eb059f81ff694 https://sqlite.org/forum/forumpost/7d3eb059f81ff694
- lysace 9mo ago[flagged]
- Forgeties79 9mo agoThere are people behind the web crawler. If they’re so well funded they can exert a little effort to not so badly inconvenience people as they steal their training data.
- lysace 9mo ago[flagged]
- mikestew 9mo agoIt may come as shock to you ("Video/audio producer") It’s one thing to ignore parent’s point entry, but no reason to be an ass about it.
- deleted 9mo ago[deleted]
- NegativeK 9mo agoI've downvoted you for being incredibly aggressive in your responses. I'm not sure why you're ad homineming the parent commenter, but it's not helping the discussion.
- deleted 9mo ago[deleted]
- Forgeties79 9mo agoI don’t even really get what they are saying. I am also saying that they are hostile, and with all of their money they can afford to not be hostile. So I feel like we agree?
- juliangmp 9mo ago"Why don't you just clone the repo?" Yes. Why dont you? If you're gonna grab a repo to make a code theft machine then at least dont ddos the servers while you're at it.
- lysace 9mo ago[flagged]
- ninkendo 9mo agoWhy don’t you take a moment to explain to the class why you think web crawling means you can’t cache anything? It seems to me that the very first thing I’d try to solve if I were writing a tool for an LLM to search the web, would be caching. An LLM should have to go through a proxy to fetch any URL. That proxy should be caching results. The cache should be stored on the LLM’s company’s servers. It should not be independently hitting the same endpoint repeatedly any time it wants to fetch the same URL for its users. Is it expensive to cache everything the LLM fetches? You betcha. Can they afford to spend of the billions they have for capex to buy some fucking hard drives? Absolutely. If archive.org can do it via funding from donations, a trillion dollar AI company should have no problem.
- nitwit005 9mo ago"The malefactor behind this attack" isn't a complaint about the web crawler.
- squigz 9mo ago[flagged]
- LastTrain 9mo agoOK. How about shitty and selfish then?
- Afforess 9mo agoSounds like you have zero empathy for the real costs AI is driving and feelings that this creates for website owners. How about you pony up and pay for your scraping?
- immibis 9mo agoThere's zero evidence any of this is related to AI btw
- Forgeties79 9mo agoWhen they routinely do things like take down public libraries yes I consider it evil too.
- sensanaty 9mo agoWhat other word would you use? I find "evil" quite an apt description.
- PrairieFire 9mo agoI am with you in that this rhetoric is getting exhausting. In this particular case though I don't think "evil” is a moral claim, more shorthand for cost externalizing behavior. Hammering expensive dynamic endpoints with millions of unique requests isn’t neutral automation, it's degrading a shared public resource. Call it evil, antisocial, or extractive, the outcome is the same.
- consp 9mo ago> shorthand for cost externalizing behavior I consider that evil, having no regard for the wellbeing of others for you own greed.