Background: p-values are ubiquitous in scientific research, yet they fundamentally fail to quantify the strength of evidence for or against competing hypotheses. This limitation is particularly problematic in neuroimaging meta-analyses, where researchers need to assess how strongly the available data support specific and spatially consistent patterns of brain activation across studies. Methods: In this work, we present a practical approach that transforms p-values into their corresponding upper bounds on the Bayes factor, which quantify the maximum plausible evidence in favor of the alternative hypothesis given the observed data. The method is illustrated within the framework of Activation Likelihood Estimation, the most widely used coordinate-based meta-analytic technique in neuroimaging and applied to a reference dataset comprising 73 finger-tapping experiments. Results: The results show that effects traditionally classified as statistically significant using the canonical Activation Likelihood Estimation framework actually span a wide range of evidential strengths, with Bayes factor bounds varying approximately from 46 to 410. This finding reveals substantial heterogeneity in weight of evidence that is concealed by conventional threshold-based inference. Conclusion: By enabling the construction of voxel-wise maps of evidential strength while remaining fully compatible with existing analysis pipelines, the proposed approach helps to avoid common misinterpretations of p-values and improves the interpretability and reliability of neuroimaging meta-analytic conclusions. It therefore provides a conservative, Bayesian-inspired complement to standard significance maps.

Extracting Weight of Evidence from p-Value via Bayesian Approach to Activation Likelihood Estimation Meta-Analysis

Costa, Tommaso
First
;
Manuello, Jordi
;
Cauda, Franco;Crocetta, Annachiara;Liloia, Donato
Last
2026-01-01

Abstract

Background: p-values are ubiquitous in scientific research, yet they fundamentally fail to quantify the strength of evidence for or against competing hypotheses. This limitation is particularly problematic in neuroimaging meta-analyses, where researchers need to assess how strongly the available data support specific and spatially consistent patterns of brain activation across studies. Methods: In this work, we present a practical approach that transforms p-values into their corresponding upper bounds on the Bayes factor, which quantify the maximum plausible evidence in favor of the alternative hypothesis given the observed data. The method is illustrated within the framework of Activation Likelihood Estimation, the most widely used coordinate-based meta-analytic technique in neuroimaging and applied to a reference dataset comprising 73 finger-tapping experiments. Results: The results show that effects traditionally classified as statistically significant using the canonical Activation Likelihood Estimation framework actually span a wide range of evidential strengths, with Bayes factor bounds varying approximately from 46 to 410. This finding reveals substantial heterogeneity in weight of evidence that is concealed by conventional threshold-based inference. Conclusion: By enabling the construction of voxel-wise maps of evidential strength while remaining fully compatible with existing analysis pipelines, the proposed approach helps to avoid common misinterpretations of p-values and improves the interpretability and reliability of neuroimaging meta-analytic conclusions. It therefore provides a conservative, Bayesian-inspired complement to standard significance maps.
2026
16
1
1
9
https://www.mdpi.com/2076-3425/16/1/87
weight of evidence, Bayes factor, p-value, Activation Likelihood Estimation
Costa, Tommaso; Manuello, Jordi; Cauda, Franco; Crocetta, Annachiara; Liloia, Donato
File in questo prodotto:
File Dimensione Formato  
brainsci-16-00087-with-cover.pdf

Accesso aperto

Tipo di file: PDF EDITORIALE
Dimensione 512.44 kB
Formato Adobe PDF
512.44 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/2114190
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact