Simulating discounted costs

The estimation of discounted costs can be derived by simulation methodologies for systems displaying stochastic fluctuations in which conventional numerical methods are inefficient. Simulation methodologies utilizing algorithms for discounted cost problems provide a technique for reducing variance when modelling stochastic simulations, including non-Markov processes or infinite state space Markov chains.