Bayesian Estimation of Autoregressive Models with Exogenous Variables Under Scale-Mixtures of Normal Errors
Open Access
- 18 June 2026
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 14 (12) , 2188
Abstract
Autoregressive models with exogenous variables (ARX) constitute a fundamental class of dynamic regression models used extensively for time series analysis across a wide range of applications. A pervasive limitation of the existing Bayesian analyses of ARX models is their near-exclusive reliance on the Gaussian error assumption, which is routinely violated in empirical applications exhibiting heavy-tailed innovations, distributional outliers, or excess kurtosis. To address this deficiency, we develop a rigorous Bayesian estimation framework for these models whose errors are drawn from the scale-mixtures of normal (SMN) family, which is a rich, symmetric, heavy-tailed class of distributions. Exploiting the hierarchical stochastic representation of the SMN family through observation-specific latent scale-mixing variables, the ARX model is embedded in an augmented data structure that restores Gaussian conditional structure. Under three distinct prior formulations—namely, normal-gamma, Zellner’s g-prior, and Jeffreys’ prior—we derive closed-form full conditional posterior distributions for the ARX coefficient vector and the error scale parameter, which follow multivariate normal and inverse-gamma distributions, respectively. In addition, for the SMN-specific shape parameters, we derive the full conditional posteriors for each distribution in the family, and some of them are non-standard distributions handled by embedding Metropolis-Hastings steps within the Gibbs sampler. The resulting hybrid MCMC algorithm is validated through a comprehensive simulation study spanning three ARX model configurations and all three SMN special cases. A real macroeconomic application to US consumer price inflation demonstrates the practical utility of the framework, confirming heavy-tailed residuals and yielding precise, well-calibrated posterior estimates.Keywords
Funding Information
- Princess Nourah Bint Abdulrahman University (SPTIF-2026)
- Najran University (NU/CPL/SERC/14/4440-1)
This publication has 33 references indexed in Scilit:
- Bayesian modeling and forecasting of seasonal autoregressive models with scale-mixtures of normal errorsComputational Statistics, 2025
- Full Bayesian identification of linear dynamic systems using stable kernelsProceedings of the National Academy of Sciences, 2023
- Robust identification of linear ARX models with recursive EM algorithm based on Student’s t-distributionJournal of the Franklin Institute, 2021
- Autoregressive Models with Mixture of Scale Mixtures of Gaussian InnovationsIranian Journal of Science and Technology, Transactions A: Science, 2017
- RARE SHOCKS, GREAT RECESSIONSJournal of Applied Econometrics, 2014
- Kernel methods in system identification, machine learning and function estimation: A surveyAutomatica, 2014
- Bayesian analysis of skew-normal independent linear mixed models with heterogeneity in the random-effects populationJournal of Statistical Planning and Inference, 2012
- Bayes inference in regression models with ARMA (p, q) errorsJournal of Econometrics, 1994
- The Calculation of Posterior Distributions by Data AugmentationJournal of the American Statistical Association, 1987
- Bayesian system identificationAutomatica, 1981