Markov Chains and Monte Carlo Algorithms

1. General state space Markov chains Most applications of Markov Chain Monte Carlo algorithms (MCMC) are concerned with continuous random variables, i.e the corresponding Markov chain has a continuous state space S. In this section we will give a brief overview of the theory underlying Markov chains with general state spaces. Although the basic principles… Continue reading Markov Chains and Monte Carlo Algorithms