Yukito Iba
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Yukito Iba has a total of 15 co-authors. Here are the top co-authors by number of shared publications:
- Nen Saito
Hiroshima University
4 shared publications - Koji Hukushima
The University of Tokyo
3 shared publications - Akimasa Kitajima
Research and Legislative Reference Bureau, National Diet Library, Chiyoda-ku, Tokyo, Japan; Department of Physics, Graduate School of Science, Osaka university, Toyonaka, Osaka, Japan
2 shared publications Macoto Kikuchi
Department of Physics Osaka University 560-0043 Toyonaka Japan
2 shared publications- Akimasa Kitajima
Graduate School of Science and Cybermedia Center Osaka University 560-0043 Toyonaka Osaka Japan
1 shared publication - George Chikenji1 shared publication
Latest Publications
- Open Access
Bias correction of posterior means using MCMC outputs
We propose algorithms for addressing the bias of the posterior mean when used as an estimator of parameters. These algorithms build upon the recently proposed Bayesian infinitesimal jackknife approximation (Giordano and Broderick (2023)) and can be implemented using the posterior covariance and third-order combined cumulants easily calculated from MCMC outputs. Two algorithms are introduced: The first algorithm utilises the output of a single-run MCMC with the original likelihood and prior to estimate the bias. A notable feature of the algorithm is that its ability to estimate definitional bias (Efron (2015)), which is crucial for Bayesian estimators. The second algorithm is designed for high-dimensional and sparse data settings, where ``quasi-prior'' for bias correction is introduced. The quasi-prior is iteratively refined using the output of the first algorithm as a measure of the residual bias at each step. These algorithms have been successfully implemented and tested for parameter estimation in the Weibull distribution and logistic regression in moderately high-dimensional settings.
Open AccessBias correction of posterior means using MCMC outputs
We propose algorithms for addressing the bias of the posterior mean when used as an estimator of parameters. These algorithms build upon the recently proposed Bayesian infinitesimal jackknife approximation (Giordano and Broderick (2023)) and can be implemented using the posterior covariance and third-order combined cumulants easily calculated from MCMC outputs. Two algorithms are introduced: The first algorithm utilises the output of a single-run MCMC with the original likelihood and prior to estimate the bias. A notable feature of the algorithm is that its ability to estimate definitional bias (Efron (2015)), which is crucial for Bayesian estimators. The second algorithm is designed for high-dimensional and sparse data settings, where ``quasi-prior'' for bias correction is introduced. The quasi-prior is iteratively refined using the output of the first algorithm as a measure of the residual bias at each step. These algorithms have been successfully implemented and tested for parameter estimation in the Weibull distribution and logistic regression in moderately high-dimensional settings.
- 12 June 2023
- Published by MIT Press in Neural Computation
- Vol. 35 (7) , 1340-1361
Posterior Covariance Information Criterion for Weighted Inference
For predictive evaluation based on quasi-posterior distributions, we develop a new information criterion, the posterior covariance information criterion (PCIC). PCIC generalizes the widely applicable information criterion (WAIC) so as to effectively handle predictive scenarios where likelihoods for the estimation and the evaluation of the model may be different. A typical example of such scenarios is the weighted likelihood inference, including prediction under covariate shift and counterfactual prediction. The proposed criterion uses a posterior covariance form and is computed by using only one Markov chain Monte Carlo run. Through numerical examples, we demonstrate how PCIC can apply in practice. Further, we show that PCIC is asymptotically unbiased to the quasi-Bayesian generalization error under mild conditions in weighted inference with both regular and singular statistical models.
- 12 June 2023
- Published by MIT Press in Neural Computation
- Vol. 35 (7) , 1340-1361
Posterior Covariance Information Criterion for Weighted Inference
For predictive evaluation based on quasi-posterior distributions, we develop a new information criterion, the posterior covariance information criterion (PCIC). PCIC generalizes the widely applicable information criterion (WAIC) so as to effectively handle predictive scenarios where likelihoods for the estimation and the evaluation of the model may be different. A typical example of such scenarios is the weighted likelihood inference, including prediction under covariate shift and counterfactual prediction. The proposed criterion uses a posterior covariance form and is computed by using only one Markov chain Monte Carlo run. Through numerical examples, we demonstrate how PCIC can apply in practice. Further, we show that PCIC is asymptotically unbiased to the quasi-Bayesian generalization error under mild conditions in weighted inference with both regular and singular statistical models.
- Open Access
Backward Simulation of Stochastic Process using a Time Reverse Monte Carlo method
The "backward simulation" of a stochastic process is defined as the stochastic dynamics that trace a time-reversed path from the target region to the initial configuration. If the probabilities calculated by the original simulation are easily restored from those obtained by backward dynamics, we can use it as a computational tool. It is shown that the naive approach to backward simulation does not work as expected. As a remedy, the Time Reverse Monte Carlo method (TRMC) based on the ideas of Sequential Importance Sampling (SIS) and Sequential Monte Carlo (SMC) is proposed and successfully tested with a stochastic typhoon model and the Lorenz 96 model. TRMC with SMC, which contains resampling steps, is shown to be more efficient for simulations with a larger number of time steps. A limitation of TRMC and its relation to the Bayes formula are also discussed.
Open AccessBackward Simulation of Stochastic Process using a Time Reverse Monte Carlo method
The "backward simulation" of a stochastic process is defined as the stochastic dynamics that trace a time-reversed path from the target region to the initial configuration. If the probabilities calculated by the original simulation are easily restored from those obtained by backward dynamics, we can use it as a computational tool. It is shown that the naive approach to backward simulation does not work as expected. As a remedy, the Time Reverse Monte Carlo method (TRMC) based on the ideas of Sequential Importance Sampling (SIS) and Sequential Monte Carlo (SMC) is proposed and successfully tested with a stochastic typhoon model and the Lorenz 96 model. TRMC with SMC, which contains resampling steps, is shown to be more efficient for simulations with a larger number of time steps. A limitation of TRMC and its relation to the Bayes formula are also discussed.
- 15 December 2018
- Published by Physical Society of Japan in Journal of the Physical Society of Japan
- Vol. 87 (12)
Backward Simulation of Stochastic Process Using a Time Reverse Monte Carlo Method
The “backward simulation” of a stochastic process is defined as the stochastic dynamics that trace a time-reversed path from the target region to the initial configuration. If the probabilities calculated by the original simulation are easily restored from those obtained by backward dynamics, we can use it as a computational tool. It is shown that the naïve approach to backward simulation does not work as expected. As a remedy, the time reverse Monte Carlo method (TRMC) based on the ideas of sequential importance sampling (SIS) and sequential Monte Carlo (SMC) is proposed and successfully tested with a stochastic typhoon model and the Lorenz 96 model. TRMC with SMC, which contains resampling steps, is found to be more efficient for simulations with a larger number of time steps. A limitation of TRMC and its relation to the Bayes formula are also discussed.
- 15 December 2018
- Published by Physical Society of Japan in Journal of the Physical Society of Japan
- Vol. 87 (12)
Backward Simulation of Stochastic Process Using a Time Reverse Monte Carlo Method
The “backward simulation” of a stochastic process is defined as the stochastic dynamics that trace a time-reversed path from the target region to the initial configuration. If the probabilities calculated by the original simulation are easily restored from those obtained by backward dynamics, we can use it as a computational tool. It is shown that the naïve approach to backward simulation does not work as expected. As a remedy, the time reverse Monte Carlo method (TRMC) based on the ideas of sequential importance sampling (SIS) and sequential Monte Carlo (SMC) is proposed and successfully tested with a stochastic typhoon model and the Lorenz 96 model. TRMC with SMC, which contains resampling steps, is found to be more efficient for simulations with a larger number of time steps. A limitation of TRMC and its relation to the Bayes formula are also discussed.
- Open Access
Multicanonical MCMC for Sampling Rare Events
Multicanonical MCMC (Multicanonical Markov Chain Monte Carlo; Multicanonical Monte Carlo) is discussed as a method of rare event sampling. Starting from a review of the generic framework of importance sampling, multicanonical MCMC is introduced, followed by applications in random matrices, random graphs, and chaotic dynamical systems. Replica exchange MCMC (also known as parallel tempering or Metropolis-coupled MCMC) is also explained as an alternative to multicanonical MCMC. In the last section, multicanonical MCMC is applied to data surrogation; a successful implementation in surrogating time series is shown. In the appendices, calculation of averages and normalizing constant in an exponential family, phase coexistence, simulated tempering, parallelization, and multivariate extensions are discussed.
Open AccessMulticanonical MCMC for Sampling Rare Events
Multicanonical MCMC (Multicanonical Markov Chain Monte Carlo; Multicanonical Monte Carlo) is discussed as a method of rare event sampling. Starting from a review of the generic framework of importance sampling, multicanonical MCMC is introduced, followed by applications in random matrices, random graphs, and chaotic dynamical systems. Replica exchange MCMC (also known as parallel tempering or Metropolis-coupled MCMC) is also explained as an alternative to multicanonical MCMC. In the last section, multicanonical MCMC is applied to data surrogation; a successful implementation in surrogating time series is shown. In the appendices, calculation of averages and normalizing constant in an exponential family, phase coexistence, simulated tempering, parallelization, and multivariate extensions are discussed.
- 9 April 2014
- Published by Springer Nature in Annals of the Institute of Statistical Mathematics
- Vol. 66 (3) , 611-645
Multicanonical MCMC for sampling rare events: an illustrative review
- 9 April 2014
- Published by Springer Nature in Annals of the Institute of Statistical Mathematics
- Vol. 66 (3) , 611-645
Multicanonical MCMC for sampling rare events: an illustrative review
- Open Access
Multicanonical sampling of rare events in random matrices
A method based on multicanonical Monte Carlo is applied to the calculation of large deviations in the largest eigenvalue of random matrices. The method is successfully tested with the Gaussian orthogonal ensemble (GOE), sparse random matrices, and matrices whose components are subject to uniform density. Specifically, the probability that all eigenvalues of a matrix are negative is estimated in these cases down to the values of $\sim 10^{-200}$, a region where naive random sampling is ineffective. The method can be applied to any ensemble of matrices and used for sampling rare events characterized by any statistics.Open AccessMulticanonical sampling of rare events in random matrices
A method based on multicanonical Monte Carlo is applied to the calculation of large deviations in the largest eigenvalue of random matrices. The method is successfully tested with the Gaussian orthogonal ensemble (GOE), sparse random matrices, and matrices whose components are subject to uniform density. Specifically, the probability that all eigenvalues of a matrix are negative is estimated in these cases down to the values of $\sim 10^{-200}$, a region where naive random sampling is ineffective. The method can be applied to any ensemble of matrices and used for sampling rare events characterized by any statistics. - Open Access
Multicanonical Sampling of Rare Trajectories in Chaotic Dynamical Systems
In chaotic dynamical systems, a number of rare trajectories with low level of chaoticity are embedded in chaotic sea, while extraordinary unstable trajectories can exist even in weakly chaotic regions. In this study, a quantitative method for searching these rare trajectories is developed; the method is based on multicanonical Monte Carlo and can estimate the probability of initial conditions that lead to trajectory fragments of a given level of chaoticity. The proposed method is successfully tested with four-dimensional coupled standard maps, where probabilities as small as $10^{-14}$ are estimated.Open AccessMulticanonical Sampling of Rare Trajectories in Chaotic Dynamical Systems
In chaotic dynamical systems, a number of rare trajectories with low level of chaoticity are embedded in chaotic sea, while extraordinary unstable trajectories can exist even in weakly chaotic regions. In this study, a quantitative method for searching these rare trajectories is developed; the method is based on multicanonical Monte Carlo and can estimate the probability of initial conditions that lead to trajectory fragments of a given level of chaoticity. The proposed method is successfully tested with four-dimensional coupled standard maps, where probabilities as small as $10^{-14}$ are estimated. - 30 September 2010
- Published by American Physical Society (APS) in Physical Review E
- Vol. 82 (3) , 031142
Multicanonical sampling of rare events in random matrices
A method based on multicanonical Monte Carlo is applied to the calculation of large deviations in the largest eigenvalue of random matrices. The method is successfully tested with the Gaussian orthogonal ensemble, sparse random matrices, and matrices whose components are subject to uniform density. Specifically, the probability that all eigenvalues of a matrix are negative is estimated in these cases down to the values of $\sim${}10$-${}200, a region where simple random sampling is ineffective. The method can be applied to any ensemble of matrices and used for sampling rare events characterized by any statistics.
- 30 September 2010
- Published by American Physical Society (APS) in Physical Review E
- Vol. 82 (3) , 031142
Multicanonical sampling of rare events in random matrices
A method based on multicanonical Monte Carlo is applied to the calculation of large deviations in the largest eigenvalue of random matrices. The method is successfully tested with the Gaussian orthogonal ensemble, sparse random matrices, and matrices whose components are subject to uniform density. Specifically, the probability that all eigenvalues of a matrix are negative is estimated in these cases down to the values of $\sim${}10$-${}200, a region where simple random sampling is ineffective. The method can be applied to any ensemble of matrices and used for sampling rare events characterized by any statistics.
- Open Access
Exploration of Order in Chaos with Replica Exchange Monte Carlo
A method for exploring unstable structures generated by nonlinear dynamical systems is introduced. It is based on the sampling of initial conditions and parameters by Replica Exchange Monte Carlo (REM), and efficient both for the search of rare initial conditions and for the combined search of rare initial conditions and parameters. Examples discussed here include the sampling of unstable periodic orbits in chaos and search for the stable manifold of unstable fixed points, as well as construction of the global bifurcation diagram of a map.
Open AccessExploration of Order in Chaos with Replica Exchange Monte Carlo
A method for exploring unstable structures generated by nonlinear dynamical systems is introduced. It is based on the sampling of initial conditions and parameters by Replica Exchange Monte Carlo (REM), and efficient both for the search of rare initial conditions and for the combined search of rare initial conditions and parameters. Examples discussed here include the sampling of unstable periodic orbits in chaos and search for the stable manifold of unstable fixed points, as well as construction of the global bifurcation diagram of a map.