3 ms·
Wow, a rate of drop-out like that would certainly make me doubtful of the results of the study. It seems reasonably likely that people dropped-out in a fashion
by joe_the_user 8y ago
Wow,
a rate of drop-out like that would certainly make me doubtful of the results of the study. It seems reasonably likely that people dropped-out in a fashion that would be weighted in one way or another.
- make3 8y agofor sure.. but I expect the real results to be worse (though this is purely speculative on my part), as I can only imagine people with steeper intellectual decline being more likely to drop out
- ojbyrne 8y agoIts mentioned in the paper: "However, recruitment to and retention in cognitive ageing studies is also affected by self selection to volunteer among better educated individuals who are ageing well, which is also true of our study. Thus, the findings might be biased towards those individuals with higher cognitive performance."
- mirimir 8y agoThanks for finding that. I was about to read the paper, looking for something like that.
- RyanOD 8y agoI immediately thought the same. Then I thought about for a bit longer and quickly came up with an equal number of reasons why participants experiencing more rapid mental decline might stick it out. Really no way to know.
- gweinberg 8y agoMaybe, but given the huge dropout rate I don't see how we can conclude anything from this study. Of course, that would also be true if it had reached the opposite conclusion.
- cjbprime 8y agoOr people with less decline are more busy, have less motivation to stay in touch with a study that doesn't feel relevant since they're healthy?
- sandworm101 8y agoHave you ever taken these sorts of tests? They are not fun. Many questions are childish. Others make you feel stupid for not getting them right. Both extremes are necessary to the study. I'm reminded of a study using the Nintendo Wii to help keep elderly people mobile. 90+% of them stopped playing immediately, within days, of the researchers leaving.
- joe_the_user 8y agoHave you ever taken these sorts of tests? They are not fun. Many questions are childish. Others make you feel stupid for not getting them right. Both extremes are necessary to the study. So you're saying it's logical that a lot of people dropped out? Seems reasonable. But that doesn't mean that you wouldn't have the problem of the high drop-out rate implying the final people remaining are biased sample. When you are filtering a large number of people down to a small number, making sure that small number is representative of the large number is a hard problem. Maybe there's no solution or no easy solution. Doesn't change the problem.
- bergerjac 8y ago> They are not fun. Many questions are childish. Others make you feel stupid for not getting them right. Both extremes are necessary to the study. If that's the case, then the test should say this in the instructions... (It's a classic example of setting expectations, introducing objections up front..) > This test may not feel exciting. Some questions could seem childish. Other questions could make people feel silly for marking the incorrect answer. These extremes are required for the study.
- georgeglue1 8y agoThere are some ways to adjust and counteract these effects (it's an issue with every clinical trial on serious illnesses and older populations though). A reference: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3227332/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3227332/ Sometimes, you have to trust the quality of the journal and biostatistician if you aren't able to read everything yourself.