Prototype of a complete desktop environment for emergency management. This system supported observing and interacting with the user using spoken natural language in order to both help them perform tasks and learn how to help them better. Sponsored by DARPA (2011). This was the last project for the core of the URCS team.

In this screencast, the user handles the same scenario as the preceding one, but this time they interact using only spoken natural language. This demonstrates the power of task-oriented spoken language interfaces, as well as the ability to support both spoken and graphical interaction in the same interface (if they're built properly).

Ferguson: Core intelligent decision support behavior, integration with learning components, and all UI and system infrastructure design and development.