3 ms·
I’d let them do their thing, why not?! They want the internet? This is the real internet. It looks like he doesn’t really care that much that they’re retrieving
by frizlab 3y ago
I’d let them do their thing, why not?! They want the internet? This is the real internet. It looks like he doesn’t really care that much that they’re retrieving millions of pages, so let them do their thing…
- gtirloni 3y ago> It looks like he doesn’t really care that much that they’re retrieving millions of pages It impacts the performance for the other legitimate users of that web farm ;)
- reaperducer 3y ago[flagged]
- pksebben 3y agodidn't click through to the site, didja?
- reaperducer 3y agoI did. What's your point? It doesn't negate anything I wrote.
- pksebben 3y agoJust that the site owner, most likely, did this kind of on purpose. It's fairly unlikely that he's concerned about his "data" being used because it's junk data.
- jeremyjh 3y agoSome scrapers respect robots.txt. OpenAI doesn't. SP is just informing the world at large of this fact.
- cactusplant7374 3y agoThe CTO isn't even aware of where the data is coming from (allegedly).
- Tubbe 3y ago(admittedly)
- Zambyte 3y agoThe (allegedly) implies they do know, but to avoid possible litigation they feign ignorance. The CTO of ClosedAI is probably not a complete idiot.
- latency-guy2 3y ago> The CTO of ClosedAI is probably not a complete idiot. Either way, ignorance is not an excuse despite how people generally react to it.
- whoami_nr 3y agoThats what the whole thing is about. He is complaining that they don't respect robots.txt