A formalism for stochastic decision processes with asynchronous events

Abstract

We present the generalized semi-Markov decision process (GSMDP) as a natural model for stochastic decision processes with asynchronous events in hope to spur interest in asynchronous models, often overlooked in AI literature.

Sample citation

Håkan L. S. Younes and Reid G. Simmons. 2004. A formalism for stochastic decision processes with asynchronous events. In Papers from the AAAI Workshop on Learning and Planning in Markov Processes—Advances and Challenges, 107–110, San Jose, California. AAAI Press. Technical Report WS-04-08.