Yea, if that's how this "labeling" works than the improvement is basically useless from the AI perspective because training data is supposed to improve generali

Yea, if that's how this "labeling" works than the improvement is basically useless from the AI perspective because training data is supposed to improve generalization and in this case it doesn't even generalize to a slightly modified question. Maybe it would generalize better with less overfitting on the specific question if the labelers wouldn't be allowed to give exact answers but only general concepts about the subject until the model produces the correct answer. But of course the article is just speculation based on just a few examples.