3 ms·
My assumption is that OpenAI reads the robots.txt, but indexes anyway; they just make a note of what content they weren't supposed to index.
by karaterobot 3y ago
My assumption is that OpenAI reads the robots.txt, but indexes anyway; they just make a note of what content they weren't supposed to index.
- EVa5I7bHFq9mnYK 3y agoAnd assign such content double weight in training ..