Policy generation for continuous-time stochastic domains with concurrency

Abstract

We adopt the framework of Younes, Musliner, & Simmons for planning with concurrency in continuous-time stochastic domains. Our contribution is a set of concrete techniques for policy generation, failure analysis, and repair. These techniques have been implemented in Tempastic, a novel temporal probabilistic planner, and we demonstrate the performance of the planner on two variations of a transportation domain with concurrent actions and exogenous events. Tempastic makes use of a deterministic temporal planner to generate initial policies. Policies are represented using decision trees, and we use incremental decision tree induction to efficiently incorporate changes suggested by the failure analysis.

Sample citation

Håkan L. S. Younes and Reid G. Simmons. 2004. Policy generation for continuous-time stochastic domains with concurrency. In Proceedings of the Fourteenth International Conference on Automated Planning and Scheduling, edited by Shlomo Zilberstein, Jana Koehler, and Sven Koenig, 325–333, Whistler, Canada. AAAI Press.