Model fitting is possibly the most extended problem in science. Classical approaches include the use of least-squares fitting procedures and maximum likelihood methods to estimate the value of the parameters in the model. However, in recent years, Bayesian inference tools have gained traction. Usually, Markov chain Monte Carlo (MCMC) methods are applied to inference problems, but they present some disadvantages, particularly when comparing different models fitted to the same data set. Other Bayesian methods can deal with this issue in a natural and effective way. We have implemented an importance sampling (IS) algorithm adapted to Bayesian inference problems in which the power of the noise in the observations is not known a priori. The main advantage of IS is that the model evidence can be derived directly from the so-called importance weights-while MCMC methods demand considerable postprocessing. The use of our adaptive target adaptive importance sampling (ATAIS) method is shown by inferring, on the one hand, the parameters of a simulated flaring event that includes a damped oscillation and, on the other hand, real data from the Kepler mission. ATAIS includes a novel automatic adaptation of the target distribution. It automatically estimates the variance of the noise in the model. ATAIS admits parallelization, which decreases the computational run-Times notably. We compare our method against a nested sampling method within a model selection problem.

A bayesian inference and model selection algorithm with an optimization scheme to infer the model noise power

Martino L.
;
2021-01-01

Abstract

Model fitting is possibly the most extended problem in science. Classical approaches include the use of least-squares fitting procedures and maximum likelihood methods to estimate the value of the parameters in the model. However, in recent years, Bayesian inference tools have gained traction. Usually, Markov chain Monte Carlo (MCMC) methods are applied to inference problems, but they present some disadvantages, particularly when comparing different models fitted to the same data set. Other Bayesian methods can deal with this issue in a natural and effective way. We have implemented an importance sampling (IS) algorithm adapted to Bayesian inference problems in which the power of the noise in the observations is not known a priori. The main advantage of IS is that the model evidence can be derived directly from the so-called importance weights-while MCMC methods demand considerable postprocessing. The use of our adaptive target adaptive importance sampling (ATAIS) method is shown by inferring, on the one hand, the parameters of a simulated flaring event that includes a damped oscillation and, on the other hand, real data from the Kepler mission. ATAIS includes a novel automatic adaptation of the target distribution. It automatically estimates the variance of the noise in the model. ATAIS admits parallelization, which decreases the computational run-Times notably. We compare our method against a nested sampling method within a model selection problem.
2021
Methods: Data analysis
Methods: Numerical
Methods: Statistical
Stars: Activity
Stars: Flare
File in questo prodotto:
File Dimensione Formato  
Monthly_Notices_MNRAS_2021.pdf

solo gestori archivio

Dimensione 1.27 MB
Formato Adobe PDF
1.27 MB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11769/537462
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 3
social impact