Constrained Markov Decision Processes

Author: Eitan Altman

Publisher: CRC Press

ISBN: 9780849303821

Category: Mathematics

Page: 256

View: 8664


This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs. It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives. This framework describes dynamic decision problems arising frequently in many engineering fields. A thorough overview of these applications is presented in the introduction. The book is then divided into three sections that build upon each other. The first part explains the theory for the finite state space. The author characterizes the set of achievable expected occupation measures as well as performance vectors, and identifies simple classes of policies among which optimal policies exist. This allows the reduction of the original dynamic into a linear program. A Lagranian approach is then used to derive the dual linear program using dynamic programming techniques. In the second part, these results are extended to the infinite state space and action spaces. The author provides two frameworks: the case where costs are bounded below and the contracting framework. The third part builds upon the results of the first two parts and examines asymptotical results of the convergence of both the value and the policies in the time horizon and in the discount factor. Finally, several state truncation algorithms that enable the approximation of the solution of the original control problem via finite linear programs are given.

Foclóir Gaed̈hilge Agus Béarla

An Irish-English Dictionary, Being a Thesaurus of Words, Phrases and Idioms of the Modern Irish Language, with Explanations in English

Author: Patrick Stephen Dinneen

Publisher: N.A


Category: Irish language

Page: 803

View: 6848


Advances in Chlamydiaceae Research and Application: 2012 Edition


Author: N.A

Publisher: ScholarlyEditions

ISBN: 1481612239

Category: Medical

Page: 59

View: 6404


Advances in Chlamydiaceae Research and Application / 2012 Edition is a ScholarlyBrief™ that delivers timely, authoritative, comprehensive, and specialized information about Chlamydiaceae in a concise format. The editors have built Advances in Chlamydiaceae Research and Application / 2012 Edition on the vast information databases of ScholarlyNews.™ You can expect the information about Chlamydiaceae in this eBook to be deeper than what you can access anywhere else, as well as consistently reliable, authoritative, informed, and relevant. The content of Advances in Chlamydiaceae Research and Application / 2012 Edition has been produced by the world’s leading scientists, engineers, analysts, research institutions, and companies. All of the content is from peer-reviewed sources, and all of it is written, assembled, and edited by the editors at ScholarlyEditions™ and available exclusively from us. You now have a source you can cite with authority, confidence, and credibility. More information is available at

Completely Positive Matrices

Author: Abraham Berman,Naomi Shaked-Monderer

Publisher: World Scientific

ISBN: 9789812795212

Category: Mathematics

Page: 216

View: 6281


A real matrix is positive semidefinite if it can be decomposed as A = BBOC . In some applications the matrix B has to be elementwise nonnegative. If such a matrix exists, A is called completely positive. The smallest number of columns of a nonnegative matrix B such that A = BBOC is known as the cp- rank of A . This invaluable book focuses on necessary conditions and sufficient conditions for complete positivity, as well as bounds for the cp- rank. The methods are combinatorial, geometric and algebraic. The required background on nonnegative matrices, cones, graphs and Schur complements is outlined. Contents: Preliminaries: Matrix Theoretic Background; Positive Semidefinite Matrices; Nonnegative Matrices and M -Matrices; Schur Complements; Graphs; Convex Cones; The PSD Completion Problem; Complete Positivity: Definition and Basic Properties; Cones of Completely Positive Matrices; Small Matrices; Complete Positivity and the Comparison Matrix; Completely Positive Graphs; Completely Positive Matrices Whose Graphs are Not Completely Positive; Square Factorizations; Functions of Completely Positive Matrices; The CP Completion Problem; CP Rank: Definition and Basic Results; Completely Positive Matrices of a Given Rank; Completely Positive Matrices of a Given Order; When is the CP-Rank Equal to the Rank?. Readership: Upper level undergraduates, graduate students, academics and researchers interested in matrix theory."

Common and scientific names of fishes from the United States, Canada, and Mexico

Author: Joseph S. Nelson

Publisher: Amer Fisheries Society


Category: Nature

Page: 386

View: 3839


This authoritative reference provides an accurate, up-to-date checklist of common and scientific names for all described and taxonomically valid fish species living in fresh and marine waters of North America. This edition contains 1,271 additional species and reflects numerous taxonomic changes that have occurred since 1991.This book includes: * 3,700 species * 262 families * 52 established exotics * 13 named hybrids * the rationale and methodology for common name allocation * history of changes from previous edition * extensive references * Spanish and French names * a companion CD-ROM