Composite indexes are widely used in socio-economic research, yet methodological choices often affect their reliability, leading to variability in results and uncertainty in policy applications. This study applies Multiverse Analysis to systematically assess the robustness of the Italian Equitable and Sustainable Well-being system. 68 alternative specifications for a formative index are fitted. Results show that highly performing provinces exhibit significantly greater variability across the specifications, indicating that index-based assessments may be highly sensitive to methodological assumptions. The choice of aggregation function (e.g., arithmetic vs non-linear means) does not substantially impact uncertainty. However, techniques based on Principal Component Analysis (PCA) inflate the uncertainty in the results, as predicted by authors who question the suitability of PCA for formative measurement.

On the coherence of composite indexes of well-being: Multiverse analysis for formative models of measurement

Giulio Giacomo Cantone;Venera Tomaselli
2025-01-01

Abstract

Composite indexes are widely used in socio-economic research, yet methodological choices often affect their reliability, leading to variability in results and uncertainty in policy applications. This study applies Multiverse Analysis to systematically assess the robustness of the Italian Equitable and Sustainable Well-being system. 68 alternative specifications for a formative index are fitted. Results show that highly performing provinces exhibit significantly greater variability across the specifications, indicating that index-based assessments may be highly sensitive to methodological assumptions. The choice of aggregation function (e.g., arithmetic vs non-linear means) does not substantially impact uncertainty. However, techniques based on Principal Component Analysis (PCA) inflate the uncertainty in the results, as predicted by authors who question the suitability of PCA for formative measurement.
2025
Composite indexes
Heteroskedasticity
Multiverse analysis
Uncertainty
Well-being
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11769/683709
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact