Augmenting environments with multimodal interaction

In air-traffic control centers, military command posts, and hospital emergency rooms, life-and-death decisions must be made quickly in the face of uncertain information. In these high-stress environments, professionals put a premium on safety, timeliness, team cohesiveness, and mutual awareness. Within this thesis, we argue that it is now possible, using the language of a task, to augment real-world artifacts, creating digital tools as robust, malleable, and portable as paper and other physical artifacts.