You may have to Search all our reviewed books and magazines, click the sign up button below to create a free account.
This book concerns continuous-time controlled Markov chains, also known as continuous-time Markov decision processes. They form a class of stochastic control problems in which a single decision-maker wishes to optimize a given objective function. This book is also concerned with Markov games, where two decision-makers (or players) try to optimize their own objective function. Both decision-making processes appear in a large number of applications in economics, operations research, engineering, and computer science, among other areas.An extensive, self-contained, up-to-date analysis of basic optimality criteria (such as discounted and average reward), and advanced optimality criteria (e.g., b...
A central area of study in Differential Geometry is the examination of the relationship between the purely algebraic properties of the Riemann curvature tensor and the underlying geometric properties of the manifold. In this book, the findings of numerous investigations in this field of study are reviewed and presented in a clear, coherent form, including the latest developments and proofs. Even though many authors have worked in this area in recent years, many fundamental questions still remain unanswered. Many studies begin by first working purely algebraically and then later progressing onto the geometric setting and it has been found that many questions in differential geometry can be ph...
This volume provides a general overview of discrete- and continuous-time Markov control processes and stochastic games, along with a look at the range of applications of stochastic control and some of its recent theoretical developments. These topics include various aspects of dynamic programming, approximation algorithms, and infinite-dimensional linear programming. In all, the work comprises 18 carefully selected papers written by experts in their respective fields. Optimization, Control, and Applications of Stochastic Systems will be a valuable resource for all practitioners, researchers, and professionals in applied mathematics and operations research who work in the areas of stochastic control, mathematical finance, queueing theory, and inventory systems. It may also serve as a supplemental text for graduate courses in optimal control and dynamic games.
This book is a tribute to Professor Pedro Gil, who created the Department of Statistics, OR and TM at the University of Oviedo, and a former President of the Spanish Society of Statistics and OR (SEIO). In more than eighty original contributions, it illustrates the extent to which Mathematics can help manage uncertainty, a factor that is inherent to real life. Today it goes without saying that, in order to model experiments and systems and to analyze related outcomes and data, it is necessary to consider formal ideas and develop scientific approaches and techniques for dealing with uncertainty. Mathematics is crucial in this endeavor, as this book demonstrates. As Professor Pedro Gil highlig...
This volume collects papers, based on invited talks given at the IMA workshop in Modeling, Stochastic Control, Optimization, and Related Applications, held at the Institute for Mathematics and Its Applications, University of Minnesota, during May and June, 2018. There were four week-long workshops during the conference. They are (1) stochastic control, computation methods, and applications, (2) queueing theory and networked systems, (3) ecological and biological applications, and (4) finance and economics applications. For broader impacts, researchers from different fields covering both theoretically oriented and application intensive areas were invited to participate in the conference. It brought together researchers from multi-disciplinary communities in applied mathematics, applied probability, engineering, biology, ecology, and networked science, to review, and substantially update most recent progress. As an archive, this volume presents some of the highlights of the workshops, and collect papers covering a broad range of topics.
None
This volume contains the proceedings of the Fifth International Conference on Complex Analysis and Dynamical Systems, held from May 22-27, 2011, in Akko (Acre), Israel. The papers cover a wide variety of topics in complex analysis and partial differential
This invaluable book provides approximately eighty examples illustrating the theory of controlled discrete-time Markov processes. Except for applications of the theory to real-life problems like stock exchange, queues, gambling, optimal search etc, the main attention is paid to counter-intuitive, unexpected properties of optimization problems. Such examples illustrate the importance of conditions imposed in the theorems on Markov Decision Processes. Many of the examples are based upon examples published earlier in journal articles or textbooks while several other examples are new. The aim was to collect them together in one reference book which should be considered as a complement to existin...
Continuous-time Markov decision processes (MDPs), also known as controlled Markov chains, are used for modeling decision-making problems that arise in operations research (for instance, inventory, manufacturing, and queueing systems), computer science, communications engineering, control of populations (such as fisheries and epidemics), and management science, among many other fields. This volume provides a unified, systematic, self-contained presentation of recent developments on the theory and applications of continuous-time MDPs. The MDPs in this volume include most of the cases that arise in applications, because they allow unbounded transition and reward/cost rates. Much of the material appears for the first time in book form.