Markov Chains: Models, Algorithms and Applications

Markov chains are a particularly powerful and widely used tool for analyzing a variety of stochastic (probabilistic) systems over time. This monograph will present a series of Markov models, starting from the basic models and then building up to higher-or

  • PDF / 189,799 Bytes
  • 13 Pages / 441 x 666 pts Page_size
  • 20 Downloads / 245 Views

DOWNLOAD

REPORT


INTERNATIONAL SERIES IN OPERATIONS RESEARCH & MANAGEMENT SCIENCE

Recent titles in the

Frederick S. Hillier, Series Editor, Stanford University Marosl COMPUTATIONAL TECHNIQUES OF THE SIMPLEX METHOD Harrison, Lee & Nealel THE PRACTICE OF SUPPLY CHAIN MANAGEMENT: Where Theory and Application Converge

Shanthikumar, Yao & Zijrnl STOCHASflC MODELING AND OPTIMIZ4TION OF MANUFACTURING SYSTEMS AND SUPPLY CHAINS

Nabrzyski, Schopf & Wcglarz/ GRID RESOURCE MANAGEMENT: State of the Art and Future Trends

Thissen & Herder1 CRITICAL INFRASTRUCTURES: State of the Art in Research and Application Carlsson, Fedrizzi, & FullCrl FUZZY LOGIC IN MANAGEMENT Soyer, Mazzuchi & Singpurwalld MATHEMATICAL RELIABILITY: An Expository Perspective Chakravarty & Eliashbergl MANAGING BUSINESS INTERFACES: Markenng, Engineering, and Manufacturing Perspectives

Talluri & van Ryzinl THE THEORYAND PRACTICE OF REVENUE MANAGEMENT Kavadias & LochlPROJECT SELECTION UNDER UNCERTAINTY: Dynamically Allocating Resources to Maximize Value

Brandeau, Sainfort & Pierskalld OPERATIONS RESEARCH AND HEALTH CARE: A Handbook of Methods and Applications

Cooper, Seiford & Zhul HANDBOOK OF DATA ENVELOPMENTANALYSIS: Models and Methods

Luenbergerl LINEAR AND NONLINEAR PROGRAMMING, T dEd. Sherbrookel OFUMAL INVENTORY MODELING OF SYSTEMS: Multi-Echelon Techniques, Second Edition

Chu, Leung, Hui & CheungI4th PARTY CYBER LOGISTICS FOR AIR CARGO Simchi-Levi, Wu & S h e d HANDBOOK OF QUANTITATNE SUPPLY CHAINANALYSIS: Modeling in the E-Business Era

Gass & Assadl AN ANNOTATED TIMELINE OF OPERATIONS RESEARCH: An Informal History Greenberg1 TUTORIALS ON EMERGING METHODOLOGIES AND APPLICATIONS IN OPERATIONS RESEARCH

Weberl UNCERTAINTY IN THE ELECTRIC POWER INDUSTRY: Methods and Models for Decision Support

Figueira, Greco & Ehrgottl MULTIPLE CRITERIA DECISIONANALYSIS: State of the Art Surveys

Reveliotisl REAL-TIME MANAGEMENT OF RESOURCE ALLOCATIONS SYSTEMS: A Dmrete Event Systems Approach

Kall & Mayerl STOCHASTIC LINEAR PROGRAMMING: Models, Theory, and Computation Sethi, Yan & Zhangl INVENTORYAND SUPPLY CHAIN MANAGEMENT WITH FORECAST UPDATES

COX/QUANTITATIVE HEALTH RISK ANALYSIS METHODS: Modeling the Human Health Impacts of Antibiotics Used in Food Animals

* A list of the early publications in the series is at the end of the book

*

Markov Chains: Models, Algorithms and Applications Wai-Ki Ching

Michael K. Ng

Wai-Ki Ching The University of Hong Kong Hong Kong, P.R. China

Michael K. Ng Hong Kong Baptist University Hong Kong, P.R. China

Library of Congress Control Number: 2005933263

e-ISBN- 13: 978-0387-29337-0 e-ISBN-10: 0-387-29337-X Printed on acid-free paper. 63 2006 by Springer Science+Business Media, Inc. All rights reserved. This work may not be translated or copied in whole or in part without the written permission of the publisher (Springer Science + Business Media, Inc., 233 Spring Street, New York, NY 10013, USA), except for brief excerpts in connection with reviews or scholarly analysis. Use in connection with any form of information storage and retrieva