4 ms·
This is clever but it feels like a situation where Goodhart's Law (when a measure becomes a target, it ceases to be a good measure) will apply. Once this become
by kej 3y ago
This is clever but it feels like a situation where Goodhart's Law (when a measure becomes a target, it ceases to be a good measure) will apply. Once this becomes a known test, AI text generators can optimize for it and then it won't be a reliable test anymore.