Human-Machine Interfaces Using Augmented Reality

Abstract

In recent decades, infrastructure aging, new social behavior, urban and rural environmental changes, and nature extreme events have increased in complexity. When disasters occur, saving lives, and providing access to emergency teams is a priority where every second saved is critical. Researchers in Structural Health Monitoring (SHM), government laboratories, and industry leaders are using sensors, field deployments, algorithms, and signal processing to assist and prioritize decisions. If the collection of data would be accelerated with near-real time interface with engineers in the field, emergency responders, safety, and maintenance could be integrated with machines in real-time, and new solutions could be advanced. This paper summarizes new work on human decisions exploring the concept of humanmachine- structure interfaces associated with structural dynamics and damage, to transform human decisions using new interfaces. The interface between human and structures is achieved with Augmented Reality (AR). The results include work in human-in-the-loop with application on near real-time computer vision, human-robot teaming, and a new infrastructure maintenance paradigm centered in augmenting the capabilities of humans in the field. The platform of human-robot teaming is further advanced in dynamics and control of humans using data obtained from robots and vice versa. Future research includes human-centered inspections, and humanmachine control theory.