Coin-Turning, Random Walks and Inhomogeneous Markov Chains

類似書籍推薦給您

【簡介】 This research monograph explores new frontiers in Markov chains. Although time-homogeneous Markov chains are well understood, this is not at all the case with time-inhomogeneous ones. The book, after a review on the classical theory of homogeneous chains, including the electrical network approach, introduces several new models which involve inhomogeneous chains as well as related new types of random walks (for example, "coin turning", "conservative" and "Rademacher" walk). Scaling limits, the breakdown of the classical limit theorems as well as recurrence and transience are investigated. The relationship with urn models is the subject of two chapters, providing additional connections to other parts of probability theory. Random walks on random graphs are discussed as well, as an area where the method of electric networks is especially useful. This is illustrated by presenting random walks in random environments and random labyrinths. The monograph puts emphasis on showing examples and open problems besides providing rigorous analysis of the models. Several figures illustrate the main ideas, and a large number of exercises challenge the interested reader. 【目錄】

Continuous Parameter Markov Processes and Stochastic Differential Equations

類似書籍推薦給您

This graduate text presents the elegant and profound theory of continuous parameter Markov processes and many of its applications. The authors focus on developing context and intuition before formalizing the theory of each topic, illustrated with examples. After a review of some background material, the reader is introduced to semigroup theory, including the Hille–Yosida Theorem, used to construct continuous parameter Markov processes. Illustrated with examples, it is a cornerstone of Feller’s seminal theory of the most general one-dimensional diffusions studied in a later chapter. This is followed by two chapters with probabilistic constructions of jump Markov processes, and processes with independent increments, or Lévy processes. The greater part of the book is devoted to Itô’s fascinating theory of stochastic differential equations, and to the study of asymptotic properties of diffusions in all dimensions, such as explosion, transience, recurrence, existence of steady states, and the speed of convergence to equilibrium. A broadly applicable functional central limit theorem for ergodic Markov processes is presented with important examples. Intimate connections between diffusions and linear second order elliptic and parabolic partial differential equations are laid out in two chapters, and are used for computational purposes. Among Special Topics chapters, two study anomalous diffusions: one on skew Brownian motion, and the other on an intriguing multi-phase homogenization of solute transport in porous media.