Coordinate-based meta-analyses (CBMA) allow researchers to combine the results from multiple fMRI experiments with the goal of obtaining results that are more likely to generalise. However, the interpretation of CBMA findings can be impaired by the file drawer problem, a type of publications bias that refers to experiments that are carried out but are not published. Using foci per contrast count data from the BrainMap database, we propose a zero-truncated modelling approach that allows us to estimate the prevalence of non-significant experiments. We validate our method with simulations and real coordinate data generated from the Human Connectome Project. Application of our method to the data from BrainMap provides evidence for the existence of a file drawer effect, with the rate of missing experiments estimated as at least 6 per 100 reported. The R code that we used is available at https://osf.io/ayhfv/. This article is protected by copyright. All rights reserved.

Estimating the prevalence of missing experiments in a neuroimaging meta-analysis

Montagna, Silvia;
2020-01-01

Abstract

Coordinate-based meta-analyses (CBMA) allow researchers to combine the results from multiple fMRI experiments with the goal of obtaining results that are more likely to generalise. However, the interpretation of CBMA findings can be impaired by the file drawer problem, a type of publications bias that refers to experiments that are carried out but are not published. Using foci per contrast count data from the BrainMap database, we propose a zero-truncated modelling approach that allows us to estimate the prevalence of non-significant experiments. We validate our method with simulations and real coordinate data generated from the Human Connectome Project. Application of our method to the data from BrainMap provides evidence for the existence of a file drawer effect, with the rate of missing experiments estimated as at least 6 per 100 reported. The R code that we used is available at https://osf.io/ayhfv/. This article is protected by copyright. All rights reserved.
2020
11
6
866
883
https://onlinelibrary.wiley.com/doi/10.1002/jrsm.1448
Samartsidis, Pantelis; Montagna, Silvia; Laird, Angela R; Fox, Peter T; Johnson, Timothy D; Nichols, Thomas E
File in questo prodotto:
File Dimensione Formato  
jrsm.1448.pdf

Accesso aperto

Tipo di file: PDF EDITORIALE
Dimensione 2.05 MB
Formato Adobe PDF
2.05 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/1754989
Citazioni
  • ???jsp.display-item.citation.pmc??? 18
  • Scopus 23
  • ???jsp.display-item.citation.isi??? 23
social impact