Using Simulation to Accelerate Development of User Interfaces for Autonomous Vehicles

  • Christopher R. HudsonEmail author
  • Ryan Lucius
  • Robert Gray
  • Brandon Powell
  • Matthew Doude
  • Daniel W. Carruth
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1034)


This paper outlines work being conducted at the Center for Advanced Vehicular Systems at Mississippi State University using simulated data to enable interface development for real world vehicles when hardware systems are not available. The ANVEL modeling and simulation tool was used to generate simulated video feeds. These videos feeds were provided to an information server, which was written to accept both simulated and real world camera data, and convert that data into an MJPEG over HTTP stream. An interface was written in Unity 2017 using simulated camera data received as an MJPEG from the information server. This user interface was then tested on a real world autonomous vehicle project, by passing camera data to the information server for conversion to a common vehicle interface format as the simulated camera data. This method allowed for the parallel development of user interface, without the need for physical hardware for testing, while maintaining real-time video capability.


HCI Autonomy Simulation 


  1. 1.
    Unity Game Engine.
  2. 2.
    Autonomous Navigation Virtual Environment Laboratory (ANVEL).
  3. 3.
    Isermann, R., Schaffnit, J., Sinsel, S.: Hardware-in-the-loop simulation for the design and testing of engine-control systems 7(5), 643–653 (1999)Google Scholar
  4. 4.
  5. 5.
    Rousseau, A., et al.: Electric drive vehicle development and evaluation using system simulation. IFAC Proc. 47(3), 7886–7891 (2014)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Mississippi State UniversityStarkvilleUSA

Personalised recommendations