Abstract
Developing and testing algorithms for autonomous vehicles in real world is an expensive and time consuming process. Also, in order to utilize recent advances in machine intelligence and deep learning we need to collect a large amount of annotated training data in a variety of conditions and environments. We present a new simulator built on Unreal Engine that offers physically and visually realistic simulations for both of these goals. Our simulator includes a physics engine that can operate at a high frequency for real-time hardware-in-the-loop (HITL) simulations with support for popular protocols (e.g. MavLink). The simulator is designed from the ground up to be extensible to accommodate new types of vehicles, hardware platforms and software protocols. In addition, the modular design enables various components to be easily usable independently in other projects. We demonstrate the simulator by first implementing a quadrotor as an autonomous vehicle and then experimentally comparing the software components with real-world flights.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kober, J., Bagnell, J.A., Peters, J.: Reinforcement learning in robotics: a survey. Int. J. Rob. Res. 32(11), 1238–1274 (2013). https://doi.org/10.1177/0278364913495721
Bagnell, J.A.: An invitation to imitation. Technical Report, CMU ROBOTICS INST (2015)
Weiss, K., Khoshgoftaar, T.M., Wang, D.: A survey of transfer learning. J. Big Data 3(1), 9 (2016). https://doi.org/10.1186/s40537-016-0043-6
Shah, S., Dey, D., Lovett, C., Kapoor, A.: Airsim open source platform at github. https://github.com/Microsoft/AirSim (2017)
Koenig, N., Howard, A.: Design and use paradigms for gazebo, an open-source multi-robot simulator. In: IROS (2004)
Meyer, J., Sendobry, A., Kohlbrecher, S., Klingauf, U., Von Stryk, O.: Comprehensive simulation of quadrotor uavs using ros and gazebo. In: SIMPAR, pp. 400–411. Springer (2012)
Furrer, F., Burri, M., Achtelik, M., Siegwart, R.: Rotorsa modular gazebo mav simulator framework. In: Robot Operating System (ROS), pp. 595–625. Springer (2016)
Babushkin, A.: Jmavsim. https://pixhawk.org/dev/hil/jmavsim
Meier, L., Tanskanen, P., Fraundorfer, F., Pollefeys, M.: Pixhawk: A system for autonomous flight using onboard computer vision. In: ICRA, pp. 2992–2997. IEEE (2011)
Jackson, J., Ellingson, G., McLain, T.: Rosflight: a lightweight, inexpensive mav research and development tool. In: ICUAS, pp. 758–762 (2016). https://doi.org/10.1109/ICUAS.2016.7502584
Hackflight: Simple quadcopter flight control firmware and simulator for c++ hackers. https://github.com/simondlevy/hackflight
Karis, B., Games, E.: Real shading in unreal engine 4. In: Proceedings Physically Based Shading Theory Practice (2013)
Moore, H.: Creating assets for the open world demo (2015)
Brandt, J., Deters, R., Ananda, G., Selig, M.: Uiuc propeller database, university of illinois at urbana-champaign. http://m-selig.ae.illinois.edu/props/propDB.html (2015)
Tapley, B., Ries, J., Bettadpur, S., Chambers, D., Cheng, M., Condi, F., Poole, S.: The ggm03 mean earth gravity model from grace. In: American Geophysical Union, G42A-03 (2007)
Chulliat, A., Macmillan, S., Alken, P., Beggan, C., Nair, M., Hamilton, B., Woods, A., Ridley, V., Maus, S., Thomson, A.: The US/UK world magnetic model for 2015–2020 (2015). https://doi.org/10.7289/V5TB14V7
Lanza, R., Meloni, A.: The Earth’s Magnetism: An Introduction for Geologists. Springer Science & Business Media (2006)
Stull, R.: Practical Meteorology: An Algebra-based Survey of Atmospheric Science. University of British Columbia (2015)
Braeunig, R.: Atmospheric models. http://www.braeunig.us/space/atmmodel.htm (2014)
Taylor, J.: Classical Mechanics. University Science Books (2005)
Nakayama, Y., Boucher, R.: Introduction to Fluid Mechanics. Butterworth-Heinemann (1998)
Herman, R.: A first course in differential equations for scientists and engineers. http://people.uncw.edu/hermanr/mat361/ODEBook/ (2017)
Hecker, C.: Physics, Part 3: Collision Response. Game Developer Magazine (1997)
Sabatini, A.M., Genovese, V.: A stochastic approach to noise modeling for barometric altimeters. Sensors (Basel, Switzerland) 13(11), 15,692–15,707 (2013)
Burch D., B.T.: Mariner’s Pressure Atlas: Worldwide Mean Sea Level Pressures and Standard Deviations for Weather Analysis. Starpath School of Navigation (2014)
Woodman, O.J.: An introduction to inertial navigation. Technical Report UCAM-CL-TR-696, University of Cambridge, Computer Laboratory (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Shah, S., Dey, D., Lovett, C., Kapoor, A. (2018). AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles. In: Hutter, M., Siegwart, R. (eds) Field and Service Robotics. Springer Proceedings in Advanced Robotics, vol 5. Springer, Cham. https://doi.org/10.1007/978-3-319-67361-5_40
Download citation
DOI: https://doi.org/10.1007/978-3-319-67361-5_40
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-67360-8
Online ISBN: 978-3-319-67361-5
eBook Packages: EngineeringEngineering (R0)