Unnecessary reliance on multilevel modelling to analyse nested data in neuroscience: when a traditional summary-statistics approach suffices

McNabb, C. B. ORCID: https://orcid.org/0000-0002-6434-5177 and Murayama, K. (2021) Unnecessary reliance on multilevel modelling to analyse nested data in neuroscience: when a traditional summary-statistics approach suffices. Current Research in Neurobiology, 2. 100024. ISSN 2665-945X doi: 10.1016/j.crneur.2021.100024

Abstract/Summary

Nested data structures create statistical dependence that influences the effective sample size and statistical power of a study. Several methods are available for dealing with nested data, including the summary-statistics approach and multilevel modelling (MLM). Recent publications have heralded MLM as the best method for analysing nested data, claiming benefits in power over summary-statistics approaches (e.g., the t test). However, when cluster size is equal, these approaches are mathematically equivalent. We conducted statistical simulations demonstrating equivalence of MLM and summary-statistics approaches for analysing nested data and provide supportive cases for the utility of the conventional summary-statistics approach in nested experiments. Using statistical simulations, we demonstrate that losses in power in the summary-statistics approach discussed in the previous literature are unsubstantiated. We also show that MLM sometimes suffers from frequent singular fit errors, especially when intraclass correlation is low. There are indeed many situations in which MLM is more appropriate and desirable, but researchers should be aware of the possibility that simpler analysis (i.e., summary-statistics approach) does an equally good or even better job in some situations.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/101348
Identification Number/DOI	10.1016/j.crneur.2021.100024
Refereed	Yes
Divisions	Life Sciences > School of Psychology and Clinical Language Sciences > Department of Psychology
Publisher	Elsevier
Download/View statistics	View download statistics for this item