A preorder relation for Markov reward processes

Abstract

A new preorder relation is introduced that orders states of a Markov process with an additional reward structure according to the reward gained over any interval of finite or infinite length. The relation allows the comparison of different Markov processes and includes as special cases monotone and lumpable Markov processes. © 2007 Elsevier B.V. All rights reserved.