Haptic-Audio Narrative: From Physical Simulation to Imaginative Stimulation

Abstract

This paper describes the design and development of an interactive narrative for the ‘Experimenta Vanishing Point’ media arts exhibition in 2005. The Cocktail Party Effect tells the story of the imminent extinction of Great Apes in the wild using touch and sound in the absence of visual elements. The narrative is driven by haptic-audio exploration of a virtual cocktail glass which functions as a heterodiegetic narrator, and the traversal of cut-up conversations that make up the story within. The interface was developed through a series of prototypes that explored the perception and mental imagery of a haptic-audio simulation of the invisible glass. These experiments also developed narrative functions of the haptic-audio interface beyond conventional iconic metonyms to include grammatical and dramatic special effects. Observations during the exhibition show promising narrative engagement with the piece but identify problems with the clarity of the sounds, and a conflict between the narrator and the story content.