2 ms·
I think social media discussions of science would be better informed by the concept of a ‘hierarchy of evidence’. Anecdotal data, n=1 trials of varying quality
by grafmax 2y ago
I think social media discussions of science would be better informed by the concept of a ‘hierarchy of evidence’.
Anecdotal data, n=1 trials of varying quality, correlations studies, double blind studies (with small and large cohorts), studies without attempted replication and studies with heavy replication - they are all provide evidence of varying quality and can inform the holistic scientific picture. They can all serve a purpose such as inspiring further research, providing fodder for meta analyses, etc. It simply isn’t true that gathered evidence ought to be casually discarded if it doesn’t attain the highest levels of the hierarchy of evidence. Neither is it true that some small study showing (or not showing) some supposed effect should drastically change all our lifestyle habits. The truth lies somewhere in the middle. The concept of a hierarchy of evidence can help us navigate these apparently mixed signals so prevalent in popular science discussions.
- abirch 2y agoHere’s a relevant xkcd https://xkcd.com/882/ https://xkcd.com/882/ For the small sample