1. A BAYESIAN APPROACH TO FIND RANDOM-TIME PROBABILITIES FROM EMBEDDED MARKOV CHAIN PROBABILITIES
- Author
-
Winfried K. Grassmann and Javad Tavakoli
- Subjects
Statistics and Probability ,Discrete mathematics ,Chain rule (probability) ,Markov chain mixing time ,Markov chain ,Variable-order Markov model ,Management Science and Operations Research ,Industrial and Manufacturing Engineering ,Markov renewal process ,Matrix analytic method ,Applied mathematics ,Additive Markov chain ,Markov property ,Statistics, Probability and Uncertainty ,Mathematics - Abstract
The embedded Markov chain approach is widely used in queuing theory, in particular in M/G/1 and GI/M/c queues. In these cases, one has to relate the embedded equilibrium probablities to the corresponding random-time probabilities. The classical method to do this is based on Markov renewal theory, a rather complex approach, especially if the population is finite or if there is balking. In this article we present a much simpler method to derive the random-time probabilities from the embedded Markov chain probabilities. The method is based on conditional probability. Our approach might also be applicable in such situations.
- Published
- 2007
- Full Text
- View/download PDF