3 ms·
I was pretty excited to see this paper but unfortunately it seems like they have a pretty big multiple comparisons problem. The spatial structure of their brai
by trombonechamp 7y ago
I was pretty excited to see this paper but unfortunately it seems like they have a pretty big multiple comparisons problem. The spatial structure of their brain maps and the really strong correlations scream multiple comparisons. Glancing through their methods briefly to try to figure out why, it looks like they are performing their decoding and leave-one-out cross validation independently for each small group of voxels, which should generate a ton of false positives. This is pretty easy to control for, but they didn't do the key control analysis: scramble the trial identity (category) to create null datasets and then recompute the measures. Unfortunately I bet that these null models would have had similar correlations to what they observed.