Better Accuracy for Better Science . . . Through Random Conclusions

Conducting research with human subjects can be difficult because of limited sample sizes and small empirical effects. We demonstrate that this problem can yield patterns of results that are practically indistinguishable from flipping a coin to determine the direction of treatment effects. We use this idea of random conclusions to establish a baseline for interpreting effect-size estimates, in turn producing more stringent thresholds for hypothesis testing and for statistical-power calculations. An examination of recent meta-analyses in psychology, neuroscience, and medicine confirms that, even if all considered effects are real, results involving small effects are indeed indistinguishable from random conclusions. 


https://pubmed.ncbi.nlm.nih.gov/37466102/





Comments

Popular posts from this blog

Interview of Elisabeth Bik – Scientific Editorial Director at uBiome

Expression of Concern on article published by uBiome / PubPeer scientist Elisabeth Bik

The troll Leonid Schneider & ‘For Better Science’: crank or cure?