Statistical significance in DTI group analyses: How the choice of the estimator can inflate effect sizes
By
Szabolcs David,
Hamed Y. Mesri,
Max A. Viergever,
Alexander Leemans
Posted 05 Sep 2019
bioRxiv DOI: 10.1101/755140
Diffusion magnetic resonance imaging (dMRI) is one of the most prevalent methods to investigate the micro- and macrostructure of the human brain in vivo. Prior to any group analysis, dMRI data are generally processed to alleviate adverse effects of known artefacts such as signal drift, data noise and outliers, subject motion, and geometric distortions. These dMRI data processing steps are often combined in automated pipelines, such as the one of the Human Connectome Project (HCP). While improving the performance of processing tools has clearly shown its benefits at each individual step along the pipeline, it remains unclear whether, and to what degree, choices for specific user-defined parameter settings can affect the final outcome of group analyses. In this work, we demonstrate how making such a choice for a particular processing step of the pipeline drives the final outcome of a group study. More specifically, we performed a dMRI group analysis on gender using HCP data sets and compared the results obtained with two diffusion tensor imaging estimation methods: the widely used ordinary linear least squares (OLLS) and the more reliable iterative weighted linear least squares (IWLLS). Our results show that the effect sizes for group analyses are significantly smaller with IWLLS than with OLLS. While previous literature has demonstrated higher estimation reliability with IWLLS than with OLLS using simulations, this work now also shows how OLLS can produce a larger number of false positives than IWLLS in a typical group study. We therefore highly recommend using the IWLLS method. By raising awareness of how the choice of estimator can artificially inflate effect size and thus alter the final outcome, this work may contribute to improvement of the reliability and validity of dMRI group studies.
Download data
- Downloaded 310 times
- Download rankings, all-time:
- Site-wide: 77,912
- In neuroscience: 12,034
- Year to date:
- Site-wide: 67,191
- Since beginning of last month:
- Site-wide: 67,191
Altmetric data
Downloads over time
Distribution of downloads per paper, site-wide
PanLingua
News
- 27 Nov 2020: The website and API now include results pulled from medRxiv as well as bioRxiv.
- 18 Dec 2019: We're pleased to announce PanLingua, a new tool that enables you to search for machine-translated bioRxiv preprints using more than 100 different languages.
- 21 May 2019: PLOS Biology has published a community page about Rxivist.org and its design.
- 10 May 2019: The paper analyzing the Rxivist dataset has been published at eLife.
- 1 Mar 2019: We now have summary statistics about bioRxiv downloads and submissions.
- 8 Feb 2019: Data from Altmetric is now available on the Rxivist details page for every preprint. Look for the "donut" under the download metrics.
- 30 Jan 2019: preLights has featured the Rxivist preprint and written about our findings.
- 22 Jan 2019: Nature just published an article about Rxivist and our data.
- 13 Jan 2019: The Rxivist preprint is live!