Using Simulation to Accelerate Development of User Interfaces for Autonomous Vehicles
This paper outlines work being conducted at the Center for Advanced Vehicular Systems at Mississippi State University using simulated data to enable interface development for real world vehicles when hardware systems are not available. The ANVEL modeling and simulation tool was used to generate simulated video feeds. These videos feeds were provided to an information server, which was written to accept both simulated and real world camera data, and convert that data into an MJPEG over HTTP stream. An interface was written in Unity 2017 using simulated camera data received as an MJPEG from the information server. This user interface was then tested on a real world autonomous vehicle project, by passing camera data to the information server for conversion to a common vehicle interface format as the simulated camera data. This method allowed for the parallel development of user interface, without the need for physical hardware for testing, while maintaining real-time video capability.
KeywordsHCI Autonomy Simulation
- 1.Unity Game Engine. http://www.unity3d.com
- 2.Autonomous Navigation Virtual Environment Laboratory (ANVEL). http://anvelsim.com/
- 3.Isermann, R., Schaffnit, J., Sinsel, S.: Hardware-in-the-loop simulation for the design and testing of engine-control systems 7(5), 643–653 (1999)Google Scholar
- 4.Nvidia Drive Px2. https://www.nvidia.com/en-us/self-driving-cars/drive-platform/