3 ms·
Then, I’d argue it is easier to respect robots.txt by not collecting the data if robots.txt is present.
by tareqak 4y ago
Then, I’d argue it is easier to respect robots.txt by not collecting the data if robots.txt is present.
- verdverm 4y agoI do not believe robots.txt has any legal standing, as others have said, if a human can learn from it, why not a machine? Is hating on machines being a cyber or machina-racist? We will be living side by side (and outnumbered) in the not too distant future, many people already have household robots
- tareqak 4y agoThe machine is not learning out of its own free will to better itself for its own future: the machine is an agent for organizations like OpenAI, Google, Facebook, Microsoft and the rest who are human beings exploiting the free labor of other human beings. If these organizations were willing to pay their fellow human beings a truly fair wage for their labor, then I would not have a problem here. However, these companies have a track record of doing the opposite.
- verdverm 4y agoShould all the little groups out there, and even individuals, be subject to the same restrictions? How do you know it will be used in ML training or just indexed for search?