2 ms·
Link title says "slightly", but the PDF says two different kinds of variations: variable names (slight) and problem constants (significant), and the 30% drop is
by ben_w 2y ago
Link title says "slightly", but the PDF says two different kinds of variations: variable names (slight) and problem constants (significant), and the 30% drop is on the combination of a 26 variable and also 26 variable + constant questions.
It's good to have a better test (though I bet this one will also be quickly saturated like all the others), but the title here doesn't seem justified by the page title there or the content.
- sundarurfriend 2y agoI would definitely classify both of those as slight changes. In fact I'd rename those as slight => trivial and significant => slight.
- zeroonetwothree 2y agoRight, renaming a variable should have zero effect on ability to solve (it wouldn’t for a human). Changing a constant should be very minor, probably also ~0 effect in most cases. I say this as someone that’s done many of these problems.