Multiverse Analysis is a heuristic for robust multiple models estimation where data fit many connected specifications of the same abstract model, instead of a singular or a small selection of specifications. Differently from the canonical application of multimodels, in Multiverse Analysis the probabilities of the specifications to be included in the analysis are never assumed independent of each other. Grounded in this consideration, this study provides a compact statistical characterisation of the process of elicitation of the specifications in Multiverse Analysis and conceptually adjacent methods, connecting previous insights from meta-analytical Statistics, model averaging, Network Theory, Information Theory, and Causal Inference. The calibration of the multiversal estimates is treated with references to the adoption of Bayesian Model Averaging vs. alternatives. In the applications, it is checked the theory that Bayesian Model Averaging reduces both error and uncertainty for well-specified multiversal mode

Characterisation and Calibration of Multiversal Models

Giulio Giacomo Cantone;Venera Tomaselli
2025-01-01

Abstract

Multiverse Analysis is a heuristic for robust multiple models estimation where data fit many connected specifications of the same abstract model, instead of a singular or a small selection of specifications. Differently from the canonical application of multimodels, in Multiverse Analysis the probabilities of the specifications to be included in the analysis are never assumed independent of each other. Grounded in this consideration, this study provides a compact statistical characterisation of the process of elicitation of the specifications in Multiverse Analysis and conceptually adjacent methods, connecting previous insights from meta-analytical Statistics, model averaging, Network Theory, Information Theory, and Causal Inference. The calibration of the multiversal estimates is treated with references to the adoption of Bayesian Model Averaging vs. alternatives. In the applications, it is checked the theory that Bayesian Model Averaging reduces both error and uncertainty for well-specified multiversal mode
2025
Multiverse analysis, Bayesian model averaging, Hamming distance, Influence score, Vibration-of-effect
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11769/642692
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 5
social impact