Abstract
While significant progresses in AI research are expanding the presumed limits of feasibility, the dangers of future AI agents with human level intelligence or beyond exhibiting a hostile behavior towards humans have been increasingly discussed. A lot of ethical concerns have been expressed in this context, whereby AI Safety research was classically focused on how to create safe and ethical AI systems. By contrast, Pistono and Yampolskiy (2016) proposed a new important approach inspired by the cybersecurity paradigm and analyzing the unethical development of an AI with malice in design. In this paper, we connect the ethical concerns raised by a Malevolent Artificial Intelligence (MAI) as characterized in their work, to those raised by a possible maliciously crafted human-machine intelligence merger. We elaborate on how both concepts could be related or even intertwined, but would also exhibit specific differences. Our analysis reveals a wide array of alarming potential risks and suggests integrating considerations concerning the safety of AI systems as well as such affecting the safety of cyborgian systems into a joint interdisciplinary framework covering various developments towards Superintelligence.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bhavsar, N.: Elon Musk: To Survive The Age of Artificial Intelligence, Humanity Must Achieve Symbiosis With Machines (2016). http://futurism.com/neural-lace-what-humanity-needs-to-survive-the-age-of-artificial-intelligence/
Bostrom, N.: Superintelligence: Paths, Dangers, Strategies. Oxford University Press, Oxford (2014)
Chalmers, D.J.: The singularity: a philosophical analysis. J. Conscious. Stud. 17 (2010)
Clark, A.: Natural-Born Cyborgs. Oxford University Press, Oxford (2004)
Clynes, M., Kline, N.: Cyborgs and space. Astronautics, 74–75 (1960)
DARPA: Bridging the Bio-Electronic Divide (2016). http://www.darpa.mil/news-events/2015-01-19. Accessed 11 Nov 2016
Future of Life Institute: Asilomar Ai Principles (2017). https://futureoflife.org/ai-principles/
Haraway, D.: A manifesto for Cyborgs: science, technology, and socialist feminism in the 1980s. Aust. Feminist Stud. 2(4), 1–42 (1987)
Herff, C., Schultz, T.: Automatic speech recognition from neural signals: a focused review. Front. Neurosci. 10, 429 (2016)
Highfield, R.: Interview with Stephen Hawking (2001). http://www.telegraph.co.uk/news/science/science-news/4766816/Interview-with-Stephen-Hawking.html. Accessed 11 Nov 2016
Jeffries, S.: Neil Harbisson: the world’s first cyborg artist (2014). https://www.theguardian.com/artanddesign/2014/may/06/neil-harbisson-worlds-first-cyborg-artist. Accessed 11 Nov 2016
Knapton, S.: Humans ’will become God-like cyborgs within 200 years’ (2015). http://www.telegraph.co.uk/culture/hay-festival/11627386/Humans-will-become-God-like-cyborgs-within-200-years.html. Accessed 11 Nov 2016
Kurzweil, R.: The Singularity is Near: When Humans Transcend Biology. Penguin (Non-Classics) (2006)
Liu, J., et al.: Syringe injectable electronics. Nat. Nanotech. 10(7), 629–636 (2015)
Mednitzer, R.: Kernel’s Quest to Enhance Human Intelligence (2016). https://lifeboat.com/blog/2016/10/kernels-quest-to-enhance-human-intelligence/
Pistono, F., Yampolskiy, R.V.: Unethical Research: How to Create a Malevolent Artificial Intelligence. In: 25th International Joint Conference on Artificial Intelligence (IJCAI-16). Ethics for Artificial Intelligence Workshop, AI-Ethics-2016, 9–15 July 2016, New York, NY (2016)
Seo, D., Carmena, J.M., Rabaey, J., Alan, E., Maharbiz, M.M.: Neural Dust: An Ultrasonic, Low Power Solution for Chronic Brain-Machine Interfaces (2013). https://arxiv.org/abs/1307.2196
Spreen, D.: Der Cyborg: Diskurse zwischen Körper und Technik. Suhrkamp 1971, 166–179 (2010)
Warwick, K.: Cyborg morals, cyborg values, cyborg ethics. Ethics Inf. Technol. 5(3), 131–1137 (2003)
Warwick, K.: The Future of Artificial Intelligence and Cybernetics (2013). https://www.bbvaopenmind.com/en/article/the-future-of-artificial-intelligence-and-cybernetics/
Yampolskiy, R.V., Spellchecker, M.S.: Artificial Intelligence Safety and Cybersecurity: A Timeline of AI Failures (2016). https://arxiv.org/abs/1610.07997
Acknowledgements
We would like to especially thank Roman Yampolskiy and further Kevin Baum for the helpful feedbacks on an earlier draft of this paper. We would also like to thank Martin Bevandic for his support.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Aliman, NM. (2017). Malevolent Cyborgization. In: Everitt, T., Goertzel, B., Potapov, A. (eds) Artificial General Intelligence. AGI 2017. Lecture Notes in Computer Science(), vol 10414. Springer, Cham. https://doi.org/10.1007/978-3-319-63703-7_18
Download citation
DOI: https://doi.org/10.1007/978-3-319-63703-7_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-63702-0
Online ISBN: 978-3-319-63703-7
eBook Packages: Computer ScienceComputer Science (R0)