Abstract
Since its emergence as an art medium, Augmented Reality has developed as a number of evidential sites. As an extension of virtual media, it merges real-time pattern recognition with media, finally realizing the fantasies of William Gibson through goggles or handheld devices. This creates a welding of a form of perceptual vision and virtual reality, or optically registered simulation overlaid upon actual spatial environments. And even though AR-based works can be traced back into the late 1990s, much of this work required at least an intermediate understanding of coding and tethered imaging equipment from webcams to goggles. It is not until the advent of marker-based AR possessing lower entries to usage, as well as geolocational AR-based media through handheld devices and tablets that Augmented Reality as an art medium would begin to propagate. While one can make arguments that much AR-based art is a convergence between handheld device art and Virtual Reality, there are gestures that are specific to Augmented Reality that allows for its specificity as a genre. In this chapter, we will look at some historical examples of AR and critical issues of the AR-based gesture, such as compounding of the gaze, problematizing the retinal, and the representational issues of informatics overlays. This also generates four gestural vectors analogous to those defined in The Translation of Virtual Art (Lichty in The Oxford Handbook of Virtuality. Oxford University Press, Oxford, 2014), which we will examine through case studies. Through these case studies, historical and recent to the time of this publication, we may determine the issues of the gestures and aesthetics of AR.
Note to the Second Edition: In the years since the publication of the original essay, many advances have taken place in the genre, both technologically and aesthetically. However, in reviewing this essay, the author also notes that some of the examples given have become historical in nature, although the theory remains sound. Given that there is little history of Augmented Reality Art at this time, the author has decided to refine the theory somewhat, keep many of the examples as historical material, and add updated works as a bridge to the time of this publication. Although some of the older works may seem dated, it is my hope that when placed in context with newer work, a continuous timeline may be seen to unfold.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
alsione svx, Stay with Miku in augmented reality. web: Youtube video documentation, http://www.youtube.com/watch?v=yRWKFauD6_w&list=UUVUW_vUhHUd_UEtzEysNtCQ&feature=c4-overview (2013). Accessed 19 Sept 2017.
Bailey J. Video terraform dance party, Banff new media institute performance. Youtube performance video documentation, http://www.youtube.com/watch?v=vNO0l4ppgIY (2008). Accessed 24 Oct 2017.
Barbier A. In 2070, From “EIO” (from “Expose Intervene. Occupy”). Web documentation, http://iam.colum.edu/abarbier/Expose/EIO.html (2012).
Berry B, Poupyrev I. Augmented groove. ATR Research Labs, Kyoto, Japan. http://www.mic.atr.co.jp/sspace/ (1999).
Brooker C. Playtest. Black Mirror, (TV Series), Channel 4 TV, UK, 21 Oct 2016.
Caudell TP, Mizell DW. Augmented reality: an application of heads-up display technology to manual manufacturing. In: Proceedings of the 25th Hawaii international conference on system sciences, IEEE Computer Society Press. Manoa: University of Hawaii; 1992.
Craft C. An audience of artists: dada, neo-dada, and the emergence of abstract expressionism. Chicago: University of Chicago Press; 2012.
Crunchyroll. Gatebox To Demo “Living With Hatsune Miku” Hologram Communication Robot. http://www.crunchyroll.com/anime-news/2017/08/10/gatebox-to-demo-living-with-hatsune-miku-hologram-communication-robot (2017). Accessed 24 Oct 2017.
Crutzen PJ, Stoermer EF. The ‘anthropocene’. Global Change Newsl. 2000; 41:17–8. International Geosphere-Biosphere Programme, Stockholm.
Crypton Inc. Vocaloid website. Web, http://www.vocaloid.com (2014). Accessed 19 Sept 2017.
Darf Design (Sahar Fikouhi and Arta Toulami). Hermaton documentation website. Web, http://www.darfdesign.com/132812/1318702/gallery/hermaton (2013). Accessed 19 Sept 2017.
De Boever A, Murray A, Roffe J. 2009. “Technical mentality” revisited: Brian Massumi on Gilbert Simondon. Web Journal, Parrhesia #7, http://parrhesiajournal.org/parrhesia07/parrhesia07_massumi.pdf (2009). Accessed 24 Oct 2017.
Esquire Magazine. Esquire’s augmented reality issue: a Tour (Nov 9, 2009). Esquire Magazine YouTube Channel. Retrieved from http://www.youtube.com/watch?v=LGwHQwgBzSI (2009). Accessed 24 Oct 2017.
Frank J. Spatial form in modern literature, the idea of spatial form. New Brunswick: Rutgers University Press; 1991.
Gibson W. Spook country. New York: Berkley; 2007.
Hart C. Alices Walking/Alices projects. http://www.claudiahart.com/portfolio/aliceswalking/ (2014).
Holmes B. Profanity and the financial markets. A user’s guide to closing the Casino. Berlin: Hatje Cantz Verlag; 2012.
Holmes K. AR occupy wall street: the augmented reality sit-in. Web, The Creators Project. http://thecreatorsproject.vice.com/blog/ar-occupy-wall-street-the-augmented-reality-sit-in (2011). Accessed 24 Oct 2017.
Holmes K. Hermaton: enter the grid is an augmented reality architectural maze. Web: The Creators Project, http://thecreatorsproject.vice.com/blog/ihermaton-enter-the-gridi-an-augmented-reality-maze (2013). Accessed 24 Oct 2017.
Hughes R. The reversible eschatology of arawakwa and gins. Web Journal, From Inflexions #6. Montreal: Concordia University; 2012.
Jorda S et al. In: Proceedings of the international computer music association. Ann Arbor: University of Michigan Press; 2005.
Kaltenbrunner M. Augmented Groove (description). From Tangible Music, http://modin.yuri.at/tangibles/?list=4 (2003–2014). Accessed 24 Oct 2017.
Karlin S. Rethinking public space: B.C. Biermann’s augmented reality urban art. Web: Fast Company, http://www.fastcocreate.com/1682447/rethinking-public-space-bc-biermann-s-augmented-reality-urban-art (2011). Accessed 24 Oct 2017.
Kato H, Billinghurst M. Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings of the 2nd IEEE and ACM international workshop on Augmented Reality (IWAR 99), October, 1999.
Lichty P. The cybernetics of performance and new media art. Leonardo. Cambridge, MA: MIT Press; 2000; 33(5):351–4.
Lichty P. An alpha revisionist manifesto: white paper. Leonardo. Cambridge, MA: MIT Press; 2001; 34(5):443–5.
Lichty P. Art in the age of dataflow. In: Currie M, Riphagen M, editors. Variant analyses: interrogations of new media art and culture. Amsterdam: Institute for Networked Culture; 2013a.
Lichty P. Digital anarchy, social media and WikiLeaks: or, Skynet doesn’t look anything like we thought it did, in variant analyses: interrogations of new media art and culture. Amsterdam: Institute for Networked Culture; 2013b.
Lichty. P. The mutant cute: meitu, the selfie, and the rewriting of global identities. Digimag 16, (May 2017).
Lichty P. Toward a culture of ubiquity, in variant analyses: interrogations of new media art and culture. Amsterdam: Institute for Networked Culture; 2013c.
Lichty P. The translation of art in virtual worlds. In: Grimshaw M, editor. The oxford handbook of virtuality. New York: Oxford University Press; 2014.
Lichty P. Virtual Kenai/into the wild (AR Tapestries). Web documentation, http://www.voyd.com/ (2014b).
Lichty P, Skwarek M. Legible City2.0/OccupyAR May Day. Web Documentation, Web, http://aroccupymayday.blogspot.com/p/artists-and-projects.html (2012). Accessed 24 Oct 2017.
Madrigal A. Bruce Sterling on why it stopped making sense to talk about ‘the internet’ in 2012. Web: The Atlantic Online, http://www.theatlantic.com/technology/archive/2012/12/bruce-sterling-on-why-it-stopped-making-sense-to-talk-about-the-internet-in-2012/266674/ (2012). Accessed 24 Oct 2017.
Massumi B. Parables for the virtual: movement, affect, sensation. Raleigh/Durham: Duke University Press; 2002.
Membit (Van Buren, J.) Richard Humann’s augmented reality art on membit, https://vimeo.com/215607961 (2017). Accessed 24 Oct 2017.
Mills M, Roukaerts T. Image recognition that triggers augmented reality. Web video: TED.com, http://www.ted.com/talks/matt_mills_image_recognition_that_triggers_augmented_reality.html (2012).
Mulvey L. Visual pleasure and narrative cinema. In: Braudy L, Cohen M, editors. Film theory and criticism. New York: Oxford University Press; 2004.
Ngai S, Adam J. Our aesthetic categories: An interview with Sianne Ngai. Fall: Cabinet Magazine; 2012.
Pappenheimer W. Watch the Sky, http://fluxfair.nyc/2016-artists/will-pappenheimer-zachary-brady/ (2016). Accessed 24 Oct 2017.
Poladian C. Virtual masks could be the future of Halloween costumes, thanks to augmented reality programs. Web, International Business Times, 29/10/13, http://www.ibtimes.com/virtual-masks-could-be-future-halloween-costumes-thanks-augmented-reality-programs-1445884 (2013). Accessed 24 Oct 2017.
Quaintance M. Patents pending: Jeremy Bailey and the future of gestural interfacing. Web: Rhizome.org; 2013.
Rappoport M. A game we play, (From “Expose Intervene. Occupy”). Web Documentation, http://expose-ar.com/?page_id=50 (2012).
Sakoff H. ‘Sight’: short film takes Google Glasses to their logical nightmarish end. Web: Huffington Post, http://www.huffingtonpost.com/2012/08/03/sight-short-film_n_1739192.html (2012). Accessed 24 Oct 2017.
Sandor C, Olwal A, Bell B, Feiner S. Immersive mixed-reality configuration of hybrid user interfaces. In ISMAR ’05, pp. 110–113 (2005).
Skwarek M. AR occupy wall street. From Web Documentation, Web, http://aroccupywallstreet.wordpress.com/ (2011). Accessed 24 Oct 2017.
Skwarek M. arOCCUPY May Day. From Web Documentation, Web, http://aroccupymayday.blogspot.com/ (2012). Accessed 24 Oct 2017.
Skwarek et al. Occupy wall street AR. AR Installation, documentation website, http://aroccupywallstreet.wordpress.com/ (2011). Accessed 24 Oct 2017.
Skwarek M. Virtual masks could be the future of Halloween costumes. Thanks to augmented reality, Blog. http://markskwarek.blogspot.com/2013/11/augmented-views-virtual-masks-could-be.html; August 11, 2013. Accessed 24 Oct 2017.
Smith G. Important portraits—Jeremy Bailey Kickstarts a solo exhibition. Web, Creative Applications Network, http://www.creativeapplications.net/news/important-portraits-jeremy-bailey-kickstarts-a-solo-exhibition/ (2013). Accessed 24 Oct 2017.
Sterling B. Augmented reality; invading the museum of modern art. Web: Beyond the Beyond, Wired.com, http://www.wired.com/beyond_the_beyond/2010/10/augmented-reality-invading-the-museum-of-modern-art/ (2010). Accessed 24 Oct 2017.
Sterling B. Patently untrue: fleshy defibrillators and synchronised baseball are changing the future. Web: Wired.co.uk, http://www.wired.co.uk/magazine/archive/2013/10/play/patently-untrue (2013). Accessed 24 Oct 2017.
Tackett R. Wanna sleep next to Hatsune Miku? There’s an app for that! Web: Rocketnews24.com. http://en.rocketnews24.com/2013/10/08/wanna-sleep-with-hatsune-miku-theres-an-app-for-that/ (2013).
Tolentino J. Get Miku into bed with Project Diva F’s AR Gimmickry. Web: Japanator, http://www.japanator.com/get-miku-into-bed-with-project-diva-f-s-ar-gimmickry-23496.phtml (2012).
Tripp S. Response to expose, intervene, occupy: a collaboration of ten artists. Web, http://expose-ar.com/?page_id=240 (2012). Accessed 24 Oct 2017.
Underkoffer J. John Underkoffer: pointing to the future of UI. Web video: TED.com, http://www.ted.com/talks/john_underkoffler_drive_3d_data_with_a_gesture.html (2010). Accessed 24 Oct 2017.
Verrier R. ‘Virtual 2Pac’ image wins award for Digital Domain. Los Angeles Times Online, http://articles.latimes.com/2012/jun/25/entertainment/la-et-ct-digital-domain-tupac-20120625 (2012). Accessed 24 Oct 2017.
Virtual Tupac at Coachella Image, Digital Domain, Web, http://digitaldomain.com/projects/271 (2012). Accessed 24 Oct 2017.
Vlahakis V, Ioannidis N, Karigiannis J, Tsotros M. Archeoguide: an augmented reality guide for archaeological sites, Computer graphics and applications. vol. 22, Issue 5. Washington, DC: IEEE Computer Society; Sept/Oct 2002.
VML. Mobile Medic. Web Documentation, http://australia.vml.com/clients/australian-defence-force (2012). Accessed 24 Oct 2017.
Williams M. Gibson’s bridge trilogy, Blog, Stories By Williams, http://storiesbywilliams.com/2012/02/05/gibsons-bridge-trilogy/ (2012). Accessed 24 Oct 2017.
Woermer M. Augmented reality chestburster t-shirt pops a xenomorph out of your torso, Web, https://io9.gizmodo.com/5938851/augmented-reality-chestburster-t-shirt-pops-a-xenomorph-out-of-your-torso (2012). Accessed 24 Oct 2017.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this chapter
Cite this chapter
Lichty, P. (2018). The Aesthetics of Liminality: Augmentation as an Art Form. In: Geroimenko, V. (eds) Augmented Reality Art. Springer Series on Cultural Computing. Springer, Cham. https://doi.org/10.1007/978-3-319-69932-5_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-69932-5_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-69931-8
Online ISBN: 978-3-319-69932-5
eBook Packages: Computer ScienceComputer Science (R0)