WaveAR: A Real-Time Sensor-Based Augmented Reality Implementation for Operating Deflection Shapes

Abstract

We present WaveAR, the first sensor-based augmented reality system for structural dynamic measurements of operating deflection shapes. WaveAR offers a significant simplification of the configuration effort of vibration sensor measurements by an automatically sensor tracking coupled by an efficient 3D scan generation of the structure. AR markers are used for sensor tracking which are placed on the sensor. This allows the determination of the sensor pose relative to the scanned structure. For this purpose the vibration sensors must be covered with AR markers. This allows a universal easy application also for existing sensor equipment. For 3D scanning and sensor tracking, a low-cost stereo depth camera is used. Because the AR application should be independent from data acquisition hardware, we have implemented a universal HTTP Rest-API interface for data acquisition connection. Through this, it is also supported to use wireless sensors. Based on this configuration, a real-time visualization in the form of an augmented reality application of the operating deflection shapes can be performed under real operating conditions. This enables the user to view the measurement from different perspectives by moving the camera around the object to be examined.