5 ms·
I got a dual-major in psychology in undergrad, and while it's not been an exceptionally useful degree, it did bequeath me with an enormous dose of skepticism to
by advael 5y ago
I got a dual-major in psychology in undergrad, and while it's not been an exceptionally useful degree, it did bequeath me with an enormous dose of skepticism toward psychometrics like this. The replication crisis solidified that skepticism
Being able to choose less "related" words doesn't sound like it has much meaningful basis at all in what we care about when we say "creativity". This metric, as many others like it, was likely chosen and popularized because it is easy to measure
- MattGaiser 5y agoI can see it being strongly correlated, as that human has more items to draw from for figuring out solutions, but I don't see how it can be used to test computer creativity. Python's random surely isn't creative.
- advael 5y agoThat's the problem with metrics though. You can make anything sound plausible. Once a model has been presented to you, you can come up with an endless stream of just-so stories for why it measures what you were told it measures. Nonetheless, some metrics simply aren't that useful, and get adopted anyway because they produce a bunch of data. Psychometrics like this have an awful track record for standing up to more meaningful tests like "Can we drive any outcome we care about with this"