You may have to Search all our reviewed books and magazines, click the sign up button below to create a free account.
Markov processes are processes that have limited memory. In particular, their dependence on the past is only through the previous state. They are used to model the behavior of many systems including communications systems, transportation networks, image segmentation and analysis, biological systems and DNA sequence analysis, random atomic motion and diffusion in physics, social mobility, population studies, epidemiology, animal and insect migration, queueing systems, resource management, dams, financial engineering, actuarial science, and decision systems. Covering a wide range of areas of application of Markov processes, this second edition is revised to highlight the most important aspects...
This book trains the next generation of scientists representing different disciplines to leverage the data generated during routine patient care. It formulates a more complete lexicon of evidence-based recommendations and support shared, ethical decision making by doctors with their patients. Diagnostic and therapeutic technologies continue to evolve rapidly, and both individual practitioners and clinical teams face increasingly complex ethical decisions. Unfortunately, the current state of medical knowledge does not provide the guidance to make the majority of clinical decisions on the basis of evidence. The present research infrastructure is inefficient and frequently produces unreliable r...
New up-to-date edition of this influential classic on Markov chains in general state spaces. Proofs are rigorous and concise, the range of applications is broad and knowledgeable, and key ideas are accessible to practitioners with limited mathematical background. New commentary by Sean Meyn, including updated references, reflects developments since 1996.
Let {Xti t ~ O} be a Markov process in Rl, and break up the path X t into (random) component pieces consisting of the zero set ({ tlX = O}) and t the "excursions away from 0," that is pieces of path X. : T ::5 s ::5 t, with Xr- = X = 0, but X. 1= 0 for T
A self-contained treatment of finite Markov chains and processes, this text covers both theory and applications. Author Marius Iosifescu, vice president of the Romanian Academy and director of its Center for Mathematical Statistics, begins with a review of relevant aspects of probability theory and linear algebra. Experienced readers may start with the second chapter, a treatment of fundamental concepts of homogeneous finite Markov chain theory that offers examples of applicable models. The text advances to studies of two basic types of homogeneous finite Markov chains: absorbing and ergodic chains. A complete study of the general properties of homogeneous chains follows. Succeeding chapters examine the fundamental role of homogeneous infinite Markov chains in mathematical modeling employed in the fields of psychology and genetics; the basics of nonhomogeneous finite Markov chain theory; and a study of Markovian dependence in continuous time, which constitutes an elementary introduction to the study of continuous parameter stochastic processes.
This book covers the classical theory of Markov chains on general state-spaces as well as many recent developments. The theoretical results are illustrated by simple examples, many of which are taken from Markov Chain Monte Carlo methods. The book is self-contained, while all the results are carefully and concisely proven. Bibliographical notes are added at the end of each chapter to provide an overview of the literature. Part I lays the foundations of the theory of Markov chain on general states-space. Part II covers the basic theory of irreducible Markov chains on general states-space, relying heavily on regeneration techniques. These two parts can serve as a text on general state-space ap...
This book is concerned with a set of related problems in probability theory that are considered in the context of Markov processes. Some of these are natural to consider, especially for Markov processes. Other problems have a broader range of validity but are convenient to pose for Markov processes. The book can be used as the basis for an interesting course on Markov processes or stationary processes. For the most part these questions are considered for discrete parameter processes, although they are also of obvious interest for continuous time parameter processes. This allows one to avoid the delicate measure theoretic questions that might arise in the continuous parameter case. There is a...
Presents algorithms for using HMMs and explains the derivation of those algorithms for the dynamical systems community.
The present volume is an extensive monograph on the analytic and geometric aspects of Markov diffusion operators. It focuses on the geometric curvature properties of the underlying structure in order to study convergence to equilibrium, spectral bounds, functional inequalities such as Poincaré, Sobolev or logarithmic Sobolev inequalities, and various bounds on solutions of evolution equations. At the same time, it covers a large class of evolution and partial differential equations. The book is intended to serve as an introduction to the subject and to be accessible for beginning and advanced scientists and non-specialists. Simultaneously, it covers a wide range of results and techniques from the early developments in the mid-eighties to the latest achievements. As such, students and researchers interested in the modern aspects of Markov diffusion operators and semigroups and their connections to analytic functional inequalities, probabilistic convergence to equilibrium and geometric curvature will find it especially useful. Selected chapters can also be used for advanced courses on the topic.
Markov Processes and Potential Theory