Trust and resilient autonomous driving systems
- 53 Downloads
Autonomous vehicles, and the larger socio-technical systems that they are a part of are likely to have a deep and lasting impact on our societies. Trust is a key value that will play a role in the development of autonomous driving systems. This paper suggests that trust of autonomous driving systems will impact the ways that these systems are taken up, the norms and laws that guide them and the design of the systems themselves. Further to this, in order to have autonomous driving systems that are worthy of our trust, we need a superstructure of oversight and a process that designs trust into these systems from the outset. Rather than banning or avoiding all autonomous vehicles should a tragedy occur, despite these systems having some level of risk, we want resilient systems that can survive tragedies, and indeed, improve from them. I will argue that trust plays a role in developing these resilient systems.
KeywordsTrust Autonomous vehicles Autonomous vehicle systems Resilience Internet of things
This material is based upon work supported by the National Science Foundation under Grant No. 1522240. Preliminary research on this topic was conducted as a Visiting Researcher at the Brocher Foundation (Switzerland) He thanks the European Research Council and the Australian National University ‘Grand Challenge’, which have provided generous support under awards Advanced Grant project on Collective Responsibility and Counterterrorism and the ‘Our Health In Our Hands’ grant, respectively. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author and do not necessarily reflect the views of the National Science Foundation, the Brocher Foundation, the European Research Council or the Australian National University.
- Clark, D. D., & Blumenthal, M. S. (2011). The end-to-end argument and application design: The role of trust. Federal Communications Law Journal,63(2), 357.Google Scholar
- Darling, K. (2017). Who’s Johnny? Anthropomorphic framing in human–robot interaction, integration, and policy. In P. Lin, K. Abney, & R. Jenkins (Eds.), Robot ethics 2.0: From autonomous cars to artificial intelligence. New York: Oxford University Press.Google Scholar
- Darling, K., Nandy, P., & Breazeal, C. (2015). Empathic concern and the effect of stories in human–robot interaction. In Proceedings of the IEEE international workshop on robot and human communication (ROMAN).Google Scholar
- Färber, B. (2016). Communication and communication problems between autonomous vehicles and human drivers. In M. Maurer, J. C. Gerdes, B. Lenz, & H. Winner (Eds.), Autonomous driving: Technical, legal and social aspects (pp. 125–147). Berlin: Springer.Google Scholar
- Fukuyama, F. (1995). Trust: The social virtues and the creation of prosperity. Glencoe, IL: Free Press Paperbacks.Google Scholar
- Kasperson, R. E., Renn, O., Slovic, P., Brown, H. S., Emel, J., Goble, R., et al. (1988). The social amplification of risk: A conceptual framework. Risk Analysis,8(2), 177–187. https://doi.org/10.1111/j.1539-6924.1988.tb01168.x.CrossRefGoogle Scholar
- Levin, S. (2018). ‘Uber should be shut down’: Friends of self driving car crash victim seek justice. The Guardian, 20 March.Google Scholar
- Lin, P. (2016). Why ethics matters for autonomous cars. In M. Maurer, J. C. Gerdes, B. Lenz, & H. Winner (Eds.), Autonomous driving: Technical, legal and social aspects (pp. 69–85). Berlin: Springer.Google Scholar
- Maurer, M. (2016). Introduction. In M. Maurer, J. C. Gerdes, B. Lenz, & H. Winner (Eds.), Autonomous driving: Technical, legal and social aspects (pp. 1–8). Berlin: Springer.Google Scholar
- McLeod, C. (2015). Trust. Retrieved April 15, 2016 from http://plato.stanford.edu/entries/trust/.
- Poppo, L., & Schepker, D. J. (2014). The repair of public trust following controllable or uncontrollable organizational failures: A conceptual framework. In J. D. Harris, B. Moriarty, & A. C. Wicks (Eds.), Public trust in business (pp. 326–360). Cambridge: Cambridge University Press.CrossRefGoogle Scholar
- Reschka, A. (2016). Safety concept for autonomous vehicles. In M. Maurer, J. C. Gerdes, B. Lenz, & H. Winner (Eds.), Autonomous driving: Technical, legal and social aspects (pp. 473–496). Berlin: Springer.Google Scholar
- Reuters. (2018). Uber settles with family of woman killed by self-driving car. The Guardian, 29 March. https://www.theguardian.com/technology/2018/mar/29/uber-settles-with-family-of-woman-killed-by-self-driving-car.
- Roff, H. M. (2013). Killing in war: Responsibility, liability, and lethal autonomous robots. In F. Allhoff, N. G. Evans, & A. Henschke (Eds.), Routledge handbook of ethics and war: Just war in the 21st century. New York: Routledge.Google Scholar
- Said, C. (2018). Uber puts the brakes on testing robot cars in california after arizona fatality. San Francisco Chronicle, 27 March. https://www.sfchronicle.com/business/article/Uber-pulls-out-of-all-self-driving-car-testing-in-12785490.php.
- T.S. (2018). Why uber’s self-driving car killed a pedestrian. The Economist, 29 March. https://www.economist.com/the-economist-explains/2018/05/29/why-ubers-self-driving-car-killed-a-pedestrian.
- UNIDR. (2014). Framing discussions on the weaponization of increasingly autonomous technologies. Geneva: United Nations Institute For Disarmament Research.Google Scholar
- Vallor, S. (2017). Artificial intelligence and public trust. Ethics of technology: The future agenda (4TU Ethics), University of Twente, Enschede, 12 June.Google Scholar
- Vlasic, B., & Apuzzo, M. (2014). Toyota is fined $1.2 billion for concealing safety defects. The New York Times, 19 March. https://www.nytimes.com/2014/03/20/business/toyota-reaches-1-2-billion-settlement-in-criminal-inquiry.html?_r=0.
- Winkle, T. (2016). Safety benefits of automated vehicles: Extended findings from accident research for development, validation and testing. In M. Maurer, J. C. Gerdes, B. Lenz, & H. Winner (Eds.), Autonomous driving: Technical, legal and social aspects (pp. 335–364). Berlin: Springer.Google Scholar
- Wolf, I. (2016). The interaction between humans and autonomous agents. In M. Maurer, J. C. Gerdes, B. Lenz, & H. Winner (Eds.), Autonomous driving: Technical, legal and social aspects (pp. 103–124). Berlin: Springer.Google Scholar
- World Health Organization. (2015). Global status report on road safety 2015. Geneva: World Health Organization.Google Scholar
- Yadron, D., & Tynan, D. (2016). Tesla driver dies in first fatal crash while using autopilot mode. The Guardian, 1 July. https://www.theguardian.com/technology/2016/jun/30/tesla-autopilot-death-self-driving-car-elon-musk.