Composite indexes are widely used in socio-economic research, yet methodological choices often affect their reliability, leading to variability in results and uncertainty in policy applications. This study applies Multiverse Analysis to systematically assess the robustness of the Italian Equitable and Sustainable Well-being system. 68 alternative specifications for a formative index are fitted. Results show that highly performing provinces exhibit significantly greater variability across the specifications, indicating that index-based assessments may be highly sensitive to methodological assumptions. The choice of aggregation function (e.g., arithmetic vs non-linear means) does not substantially impact uncertainty. However, techniques based on Principal Component Analysis (PCA) inflate the uncertainty in the results, as predicted by authors who question the suitability of PCA for formative measurement.
On the coherence of composite indexes of well-being: Multiverse analysis for formative models of measurement
Giulio Giacomo Cantone;Venera Tomaselli
2025-01-01
Abstract
Composite indexes are widely used in socio-economic research, yet methodological choices often affect their reliability, leading to variability in results and uncertainty in policy applications. This study applies Multiverse Analysis to systematically assess the robustness of the Italian Equitable and Sustainable Well-being system. 68 alternative specifications for a formative index are fitted. Results show that highly performing provinces exhibit significantly greater variability across the specifications, indicating that index-based assessments may be highly sensitive to methodological assumptions. The choice of aggregation function (e.g., arithmetic vs non-linear means) does not substantially impact uncertainty. However, techniques based on Principal Component Analysis (PCA) inflate the uncertainty in the results, as predicted by authors who question the suitability of PCA for formative measurement.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.