Stochastic Process: Problems and Solutions
It is not so very long ago that up-to-date text-books on statistics were almost non-existent. In the last few decades this deficiency has largely been remedied, but in order to cope with a broad and rapidly expanding subject many of these books have been
- PDF / 8,698,407 Bytes
- 143 Pages / 325.984 x 489.961 pts Page_size
- 42 Downloads / 516 Views
General Editor: MAURICE BARTLETT
STOCHASTIC PROCESSES
Stochastic Processes PROBLEMS AND SOLUTIONS
L. TAKACS D.Se. Professor of Mathematics Case Western Reserve University
Translated by P. ZADOR
METHUEN & CO LTD and SCIENCE PAPERBACKS
First published by Methuen & Co Ltd 11, New Fetter Lane, London E.C.4 1960 S.B.N. 416523102 1.3 First published as a Science Paperback 1966 S.B.N. 412203405 1.2 All rights reserved ISBN 978-0-412-20340-4 ISBN 978-94-011-6020-9 (eBook) DOI 10.1007/978-94-011-6020-9 THIS BOOK IS AVAILABLE IN BOTH HARDBOUND AND PAPERBACK EDITIONS
The paperback edition is sold subject to the condition that it shall not, by way of trade or otherwise, be lent, resold, hired out, or otherwise circulated without the publisher's prior consent in any form of binding or cover other than that in which it is published and without a similar condition including this condition being imposed on the subsequent purchaser
Distributed in the U.S.A. by Barnes & Noble Inc.
TO MY MOTHER
CONTENTS
GENERAL EDITOR'S PREFACE
page ix
AUTHOR'S PREFACE
x
INTRODUCTION
1
1 MARKOV CHAINS
5
1: Definition (5) 2: Transition and absolute probabilities (7) 3: Determination of the higher transition probabilities (8) 4: Classification of states (11) 5: The limit of the higher transition probabilities (13) 6: Classification of Markov chains (14) 7: The limiting distributions of irreducible Markov chains (15) Problems (17) 8: Markov chains with continuous state space (22) Problems (23) 9: Stationary stochastic sequences (24) Problems (26)
28
2 MARKOV PROCESSES 1: Introduction (28) 2: Definition (28) 3: Poisson process (29) 4: Markov process with a finite or denumerably infinite number of states (31) 5: Markov process with continuous transition (35) 6: Mixed Markov processes (36) Problems (38)
3 NON-MARKOVIAN PROCESSES
46
1: Recurrent processes (46) 2: Stationary stochastic processes (52) 3: Secondary stochastic processes generated by a stochastic process (56) Problems (57)
4 SOLUTIONS OF PROBLEMS
63
1: Markov chains (63) 2: Markov processes (84) 3: Non-Markovian processes (109)
REFERENCES
131
INDEX
137
vii
GENERAL EDITOR'S PREFACE
It is not so very long ago that up-to-date text-books on statistics
were almost non-existent. In the last few decades this deficiency has largely been remedied, but in order to cope with a broad and rapidly expanding subject many of these books have been fairly big and expensive. The success of Methuen's existing series of monographs, in physics or in biology, for example, stresses the value of short inexpensive treatments to which a student can turn for an introduction to, or a revision of, specialised topics. In this new Methuen series the still-growing importance of probability theory in its applied aspects has been recognised by coupling together Probability and Statistics; and included in the series are some of the newer applications of probability theory to stochastic models in various fields, storage and service problems, 'Monte Carlo' techniques, etc., as well as monograp
Data Loading...