Understanding the impact of preprocessing pipelines on neuroimaging cortical surface analyses.
Title | Understanding the impact of preprocessing pipelines on neuroimaging cortical surface analyses. |
Publication Type | Journal Article |
Year of Publication | 2021 |
Authors | Bhagwat N, Barry A, Dickie EW, Brown ST, Devenyi GA, Hatano K, DuPre E, Dagher A, Chakravarty MM, Greenwood CMT, Mišić B, Kennedy DN, Poline J-B |
Journal | Gigascience |
Volume | 10 |
Issue | 1 |
Date Published | 2021 01 22 |
ISSN | 2047-217X |
Keywords | Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Neuroimaging, Reproducibility of Results, Software |
Abstract | BACKGROUND: The choice of preprocessing pipeline introduces variability in neuroimaging analyses that affects the reproducibility of scientific findings. Features derived from structural and functional MRI data are sensitive to the algorithmic or parametric differences of preprocessing tasks, such as image normalization, registration, and segmentation to name a few. Therefore it is critical to understand and potentially mitigate the cumulative biases of pipelines in order to distinguish biological effects from methodological variance.METHODS: Here we use an open structural MRI dataset (ABIDE), supplemented with the Human Connectome Project, to highlight the impact of pipeline selection on cortical thickness measures. Specifically, we investigate the effect of (i) software tool (e.g., ANTS, CIVET, FreeSurfer), (ii) cortical parcellation (Desikan-Killiany-Tourville, Destrieux, Glasser), and (iii) quality control procedure (manual, automatic). We divide our statistical analyses by (i) method type, i.e., task-free (unsupervised) versus task-driven (supervised); and (ii) inference objective, i.e., neurobiological group differences versus individual prediction.RESULTS: Results show that software, parcellation, and quality control significantly affect task-driven neurobiological inference. Additionally, software selection strongly affects neurobiological (i.e. group) and individual task-free analyses, and quality control alters the performance for the individual-centric prediction tasks.CONCLUSIONS: This comparative performance evaluation partially explains the source of inconsistencies in neuroimaging findings. Furthermore, it underscores the need for more rigorous scientific workflows and accessible informatics resources to replicate and compare preprocessing pipelines to address the compounding problem of reproducibility in the age of large-scale, data-driven computational neuroscience. |
DOI | 10.1093/gigascience/giaa155 |
Alternate Journal | Gigascience |
PubMed ID | 33481004 |
PubMed Central ID | PMC7821710 |
Grant List | P41 EB019936 / EB / NIBIB NIH HHS / United States R01 MH083320 / MH / NIMH NIH HHS / United States RF1 MH120021 / MH / NIMH NIH HHS / United States R01 MH096906 / MH / NIMH NIH HHS / United States |