Prototype of a semantically-enabled desktop environment for emergency management. This system supported observing and interacting with the user using spoken natural language in order to both help them perform tasks and learn how to help them better. Sponsored by DARPA (2011).

This screencast introduces the system and the domain, but the user interacts using only the graphical UI. This demonstrates situation assessment, interleaved planning and execution, and re-planning in response to problems. It's an interesting system in itself, but in fact what really makes it interesting is being able to interact through speech, as shown in the next video.

Ferguson: Core intelligent decision support behavior, integration with learning components, and all UI and system infrastructure design and development.