Back to Search
Start Over
Markov Limid processes for representing and solving renewal problems.
- Source :
- Annals of Operations Research; Aug2014, Vol. 219 Issue 1, p63-84, 22p
- Publication Year :
- 2014
-
Abstract
- In this paper a new tool for simultaneous optimisation of decisions on multiple time scales is presented. The tool combines the dynamic properties of Markov decision processes with the flexible and compact state space representation of LImited Memory Influence Diagrams ( Limids). A temporal version of Limids, TemLimids, is defined by adding time-related functions to utility nodes. As a result, expected discounted utility, as well as expected relative utility might be used as optimisation criteria in TemLimids. Optimisation proceeds as in ordinary Limids. A sequence of such TemLimids can be used to model a Markov Limid Process, where each TemLimid represents a macro action. Algorithms are presented to find optimal plans for a sequence of such macro actions. Use of algorithms is illustrated based on an extended version of an example from pig production originally used to introduce the Limid concept. [ABSTRACT FROM AUTHOR]
- Subjects :
- MATHEMATICAL optimization
MARKOV processes
ALGORITHMS
SWINE farms
PORK industry
Subjects
Details
- Language :
- English
- ISSN :
- 02545330
- Volume :
- 219
- Issue :
- 1
- Database :
- Complementary Index
- Journal :
- Annals of Operations Research
- Publication Type :
- Academic Journal
- Accession number :
- 97051698
- Full Text :
- https://doi.org/10.1007/s10479-012-1220-4