A Formalism for Stochastic Decision Processes with Asynchronous Events

Håkan L. S. Younes Reid G. Simmons

Abstract
We present the generalized semi-Markov decision process (GSMDP) as a natural model for stochastic decision processes with asynchronous events in hope to spur interest in asynchronous models, often overlooked in AI literature.

Full paper: PDF, PS (4 pages, 19 references)

Presentation: PDF (19 slides)

Citings

  1. Wen Chen, Feiyu Lei, and Weinong Wang. 2005. A general model for non-Markovian stochastic decision discrete-event systems. In Proceedings of the 10th IEEE International Conference on Engineering of Complex Computer Systems, 132–137. IEEE Computer Society.

  2. Wen Chen, Feiyu Lei, and Weinong Wang. 2005. A general framework for analyzing the optimal call admission control in DS-CDMA cellular network. In Proceedings of the 2005 International Conference on Computational Science and its Applications, Part II, 806–815. Springer.

Valid XHTML 1.0! Håkan L. S. Younes [ Home > Publications ]
Last modified: Fri Apr 28 11:32:57 EDT 2006