Skip to main content

Feel It in My Bones: Composing Multimodal Experience Through Tissue Conduction

  • Conference paper
  • First Online:
Music Technology with Swing (CMMR 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11265))

Included in the following conference series:

Abstract

We outline here the feasibility of coherently utilising tissue conduction for spatial audio and tactile input. Tissue conduction display-specific compositional concerns are discussed; it is hypothesised that the qualia available through this medium substantively differ from those for conventional artificial means of appealing to auditory spatial perception. The implications include that spatial music experienced in this manner constitutes a new kind of experience, and that the ground rules of composition are yet to be established. We refer to results from listening experiences with one hundred listeners in an unstructured attribute elicitation exercise, where prominent themes such as “strange”, “weird”, “positive”, “spatial” and “vibrations” emerged. We speculate on future directions aimed at taking maximal advantage of the principle of multimodal perception to broaden the informational bandwidth of the display system. Some implications for composition for hearing-impaired are elucidated.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Berg, J., Rumsey, F.: Spatial attribute identification and scaling by repertory grid technique and other methods. In: Proceedings of the Audio Engineering Society International Conference on Spatial Sound Reproduction (AES16), Rovaniemi, Finland 10–12 April 1999

    Google Scholar 

  2. Bernstein, L.: The Unanswered Question: Six Talks at Harvard (Charles Eliot Norton Lectures). Harvard University Press, Cambridge, USA (1990)

    Google Scholar 

  3. Bregman, A.S.S.: Auditory Scene Analysis. MIT Press, Cambridge, MA (1990)

    Google Scholar 

  4. Cappe, C., Thut, G., Romei, V., Murray, M.M.: Auditory–visual multisensory interactions in humans: timing, topography, directionality, and sources. J. Neurosci. 30(38), 12572–12580 (2010). https://doi.org/10.1523/JNEUROSCI.1099-10.2010

    Article  Google Scholar 

  5. Chordekar, S., Kriksunov, L., Kishon-Rabin, L., Adelman, C., Sohmer, H.: Mutual cancellation between tones presented by air conduction, by bone conduction and by non-osseous (soft tissue) bone conduction. Hear. Res. 283(1–2), 180–184 (2012). https://doi.org/10.1016/j.heares.2011.10.004

    Article  Google Scholar 

  6. Clifton, T.: Music as Heard: A Study in Applied Phenomenology. Yale University Press, New Haven and London (1983)

    Google Scholar 

  7. Dietz, A.J., May, B.S., Knaus, D.A., Greeley, H.P.: Hearing protection for bone-conducted sound. In: New Directions for Improving Audio Effectiveness, Meeting Proceedings RTO-MP-HFM-123, Paper 14. Neuilly-sur-Seine, France: RTO, pp. 1–18 (2005)

    Google Scholar 

  8. Emami, S.F., Pourbakht, A., Daneshi, A., Sheykholeslami, K., Emamjome, H., Kamali, M.: Sound sensitivity of the saccule for low frequencies in healthy adults. ISRN Otolaryngol. 2013, Article ID 429680 (2013). http://dx.doi.org/10.1155/2013/429680

  9. Fodor, J.A.: Modularity of Mind: An Essay on Faculty Psychology. MIT Press, Cambridge (1983)

    Google Scholar 

  10. Gallese, V., Lakoff, G.: The brain’s concepts: the role of the sensory-motor system in conceptual knowledge. Cogn. Neuropsychol. 22(3/4), 455–479 (2005)

    Article  Google Scholar 

  11. Gardner, E., Martin, J.: Coding of Sensory Information. Princ. Neural Sci. 21, 411–429 (2000)

    Google Scholar 

  12. Gibson, J.J.: Observations on active touch. Psychol. Rev. 69(6), 477–491 (1962). https://doi.org/10.1037/h0046962

    Article  Google Scholar 

  13. Gibson, J.J.: The Senses Considered as Perceptual Systems. Allen and Unwin, London (1966)

    Google Scholar 

  14. Goldman, R.F.: “Varèse: Ionisation; Density 21.5; Intégrales; Octandre; Hyperprism; Poème Electronique. Instrumentalists, cond. Robert Craft. Columbia MS 6146 (stereo)” (in Reviews of Records). Musical Quarterly 47, no. 1. (January), pp. 133–34 (1961)

    Google Scholar 

  15. Imai, T., Kamping, S., Breitenstein, C., Pantev, C., Lutkenhoner, B., Knecht, S.: Learning of tactile frequency discrimination in humans. Hum. Brain Mapp. 18(4), 260–271 (2003)

    Article  Google Scholar 

  16. Jäncke, L.: neuroanatomy of the parietal cortex. In: Mast, F.W., Jäncke, L. (eds.) Spatial Processing in Navigation, Imagery and Perception, pp. 135–145. Springer, New York (2007)

    Chapter  Google Scholar 

  17. Jun, K.C.: Objective measurements of skull vibration during bone conduction audiometry [thesis]. Medical Faculty, Zürich University (2009)

    Google Scholar 

  18. Klemen, J., Chambers, C.D.: Current perspectives and methods in studying neural mechanisms of multisensory interactions. Neuroscience Biobehaviour Review 36, 111–133 (2012). https://doi.org/10.1016/j.neubiorev.2011.04.015

    Article  Google Scholar 

  19. Knight, K.: Snakes hear through skull vibration. J. Exp. Biol. 215, ii (2012). https://doi.org/10.1242/jeb.069104

    Article  Google Scholar 

  20. Landry, S.P., Guillemot, J.P., Champoux, F.: Audiotactile interaction can change over time in cochlear implant users. Front. Hum. Neurosci. (2014). https://doi.org/10.3389/fnhum.2014.00316

  21. Lenhardt, M.L., Shulman, A., Goldstein, B.A.: Bone-conduction propagation in the human body: implications for high-frequency therapy. Int. Tinnitus J. 13(2), 81–86 (2007)

    Google Scholar 

  22. Lennox, P.P., Myatt, A., Vaughan, J.M.: From surround to true 3-D. In: Proceedings Audio Engineering Society’s 16th International Conference: Spatial Sound Reproduction. AES (1999)

    Google Scholar 

  23. Lennox, P.P.: Cognitive maps in spatial sound. In: Proceedings Audio Engineering Society’s 52nd International Conference: Sound Field Control- Engineering and Perception. AES (2013)

    Google Scholar 

  24. Lennox, P.P.: Music as artificial environment: spatial, embodied multimodal experience. In: Wöllner, C. (ed.) Body, Sound and Space in Music and Beyond: Multimodal Explorations. Routledge, Oxford (2016)

    Google Scholar 

  25. Levanen, S., Hamdorf, D.: Feeling vibrations: enhanced tactile sensitivity in congenitally deaf adults. Neurosci. Lett. 301, 75–77 (2001)

    Article  Google Scholar 

  26. MacDonald, J.A., Henry, P.P., Letowski, T.R.: Spatial audio through a bone conduction interface. Int. J. Audiol. 45, 595–599 (2006)

    Article  Google Scholar 

  27. Macpherson, F.: Taxonomising the senses. Philos. Stud. 153, 123–142 (2011). https://doi.org/10.1007/s11098-010-9643-8

    Article  Google Scholar 

  28. McBride, M., Letowski, T., Tran, P.: Bone Conduction Head Sensitivity Mapping: Bone Vibrator. ARL-TR-3556. Army Research Laboratory: Aberdeen Proving Ground, MD, July 2005

    Google Scholar 

  29. McGurk, H., MacDonald, J.: Hearing lips and seeing voices. Nature 264(5588), 746–748 (1976)

    Article  Google Scholar 

  30. Mishkin, M., Ungerleider, L.G., Macko, K.: Object vision and spatial vision: two cortical pathways. Trends Neurosci. 6, 414–417 (1983)

    Article  Google Scholar 

  31. Music and The Drama, Varese, Ultra-Modernist Composer, Prophesies Symphonies in “Space”, The Lewiston Daily Sun, 8 December (1936)

    Google Scholar 

  32. Neuhaus, C.: ‘Music as fluid architecture’: investigating core regions of the spatial brain. In: Wöllner, C. (ed.) Body, Sound and Space in Music and Beyond: Multimodal Explorations, pp. 168–188. Routledge, Abingdon (2017)

    Chapter  Google Scholar 

  33. Rauschecker, J.P., Tian, B.: Mechanisms and streams for processing of ‘what’ and ‘where’ in auditory cortex. PNAS 97(22), 11800–11806 (2000)

    Article  Google Scholar 

  34. Rumsey, F., Mason, R.: Interaural time difference fluctuations: their measurement, subjective perceptual effect, and application in sound reproduction. In: Proceedings of the Audio Engineering Society Conference: 19th International Conference: Surround Sound-Techniques, Technology, and Perception (AES19), Schloss Elmau, Germany, 21–24 June (2001)

    Google Scholar 

  35. Rumsey, F.: Spatial quality evaluation for reproduced sound: terminology, meaning and a scene-based paradigm. J. Audio Eng. Soc. 50(9), 651–666 (2002)

    Google Scholar 

  36. Schnupp, J.W., Dawe, K.L., Pollack, G.L.: The detection of multisensory stimuli in an orthogonal sensory space. Exp. Brain Res. 162(2), 181–190 (2005). https://doi.org/10.1007/s00221-004-2136-2

    Article  Google Scholar 

  37. Schürmann, M., Caetano, G., Hlushchuk, Y., Jousmäki, V., Hari, R.: Touch activates human auditory cortex. NeuroImage 30(4), 1325–1331 (2006) (2006). http://doi.org/10.1016/j.neuroimage.2005.11.020

    Article  Google Scholar 

  38. Seifritz, E., et al.: Neural processing of auditory looming in the human brain. Curr. Biol. 23, 2147–2151 (2002)

    Article  Google Scholar 

  39. Seifritz, E., et al.: Spatiotemporal pattern of neural processing in the human auditory cortex. Science 297, 1706–1708 (2002)

    Article  Google Scholar 

  40. Shepard, R.N.: Psychophysical complementarity. In: Kubovy, M., Pomerantz, J.R. (eds.) Perceptual Organisation, pp. 279–341. Erlbaum, Hillsdale, N.J. (1981)

    Google Scholar 

  41. Shibata, D.K., Zhong J.: Tactile vibrations are heard in auditory cortex in the deaf: study with FMRI. In: Annual Meeting of the Radiological Society of North America; Chicago, lll, p. 259 (2001)

    Google Scholar 

  42. Sohmer, H.: Reflections on the role of a traveling wave along the basilar membrane in view of clinical and experimental findings. Eur. Arch. Otorhinolaryngol. 272, 531 (2015)

    Article  Google Scholar 

  43. Stanley, R., Walker, B.N.: Lateralization of sounds using bone-conduction headsets. In: Proceedings of the Annual Meeting of the Human Factors and Ergonomics Society, San Francisco, CA, pp. 1571–1575, 16–20 October (2006)

    Google Scholar 

  44. Stenfelt, S., Goode, R.L.: Transmission properties of bone conducted sound: measurements in cadaver heads. The J. Acoust. Soc. Am. 118, 2373–2391 (2005). https://doi.org/10.1121/1.2005847

    Article  Google Scholar 

  45. Stenfelt, S., Zeitooni, M.: Binaural hearing ability with mastoid applied bilateral bone conduction stimulation in normal hearing subjects. The J. Acoust. Soc. Am. 134(1), 481–493 (2013). https://doi.org/10.1121/1.4807637

    Article  Google Scholar 

  46. Sumby, W.H., Pollack, I.: Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26, 212–215 (1954)

    Article  Google Scholar 

  47. Tajadura-Jiménez, A., Väljamäe, A., Asutay, E., Västfjäll, D.: Embodied auditory perception: the emotional impact of approaching and receding sound sources. Emotion 10(2), 216–229 (2010)

    Article  Google Scholar 

  48. Todd, N.: Evidence for a behavioral significance of saccular acoustic sensitivity in humans. J. Acoust. Soc. Am. 110(1), 380–390 (2001)

    Article  Google Scholar 

  49. Todd, N.P.M., Cody, F.W.: Vestibular responses to loud dance music: a physiological basis of the rock and roll threshold? J. Acoust. Soc. Am. 107(1), 496–500 (2000)

    Article  Google Scholar 

  50. Tozzi, A., Peters, J.F.: A symmetric approach elucidates multisensory information integration. Information 8(1), 4 (2017). https://doi.org/10.3390/info8010004

    Article  Google Scholar 

  51. Trivelli, M., Potena, M., Frari, V., Petitti, T., Deidda, V., Salvinelli, F.: Compensatory role of saccule in deaf children and adults: novel hypotheses. Med. Hypotheses 80(1), 43–46 (2013)

    Article  Google Scholar 

  52. Websters New World College Dictionary. http://websters.yourdictionary.com/

  53. Werner, S., Noppeney. U.: Superadditive Responses in Superior Temporal Sulcus Predict Audiovisual Benefits in Object Categorization. Cerebral Cortex (2009). https://doi.org/10.1093/cercor/bhp248

    Article  Google Scholar 

  54. Wiggins, B.: An Investigation into the real-time manipulation and control of three-dimensional sound fields. Ph.D. thesis, University of Derby (2004)

    Google Scholar 

  55. Wilson, D., Sperber, D.: Relevance theory. In: Horn, L., Ward, G. (eds.) The Handbook of Pragmatics. Wiley-Blackwell, Oxford (2005)

    Google Scholar 

  56. Zacharov, N., Koivuniemi, K.: Audio descriptive analysis and mapping of spatial sound displays. In: Proceedings of the 7th International Conference on Auditory Display, Helsinki, Finland, pp. 95–104, 29 July–1st August (2001)

    Google Scholar 

  57. Zappa, F., Occhiogrosso, P.: The Real Frank Zappa Book. Picador, London (1989)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peter Lennox .

Editor information

Editors and Affiliations

Appendix A. – Transcribed Comments of 100 Participants

Appendix A. – Transcribed Comments of 100 Participants

Comments

Age

Sex

Mus.

Occupation

Works better than expected, what about VR/AR

40

M

N

Engineer

Very faint, weird sensation, especially with sensor under chin, crazy sensation after removal of head gear

26

F

N

Lecturer

Was an interesting experience, as someone with moderate hearing loss I could hear quite clearly. I was surprised how much conduction through the chin helped to amplify the sound

27

M

Y

Lecturer

Muddy sound, was the music recording professional quality? Difficult to get into it in current surroundings, fun though

39

M

Y

Tech

Absolutely amazing!

46

M

N

Send. Eng.

A bit band limited but still pretty good, very immersive, localisation a bit smeared, needed to close my eyes

56

M

Y

Snd. Eng.

Doesn’t surprise me in concept but surreal and interesting to use plus clarity of sound and positioning was interesting

31

F

Y

Studio Eng.

Subtle… interesting to see better coupling and more volume

37

M

N

Programmer

Uncanny, ethereal

39

F

Y

Comms.

Very surprised by HF extension plus “large soundstage”. Easy to forget you’re not listening to headphones, especially with the ear plugs installed

32

M

Y

Aud. Eng.

Spatial feel without traditional ‘stereo’ L/R fatigue. Felt as inner-head frontal image, not to external. Could clearly hear ‘wet’ recording, wanted to hear clean ones to see what it could do

37

M

Y

IT Dir.

This is something I am recently aware of. I look forward to exploring more. I’m interested in products that use this methodology. More awareness of the phenomena would be helpful to my industry and its products

42

M

U

Audio

Found this really affective, for localising sounds in a multi-channel (surround) experience. the extra conductor was especially effective at the back of the head and enhanced low frequency content substantially

25

M

U

Audio Eng.

Amazing!! Also the fact that you interact using the extra conductor. Please get my contact for further info. I want to explore this to add to the VR experience I plan to develop

41

M

U

Student

Very interesting research project, demo quite effective – much to my surprise! Keep up the good work

64

M

U

Audio Eng.

More higher quality than expected. Felt tightness of headset could be improved. Would love to try to image in a quiet room

27

M

Y

Audio Sales

Immersive experience. New way of listening. If somehow could be integrated with VR it would be cool

U

U

U

U

Enjoyed it a lot. Would have been nice if musical part went on longer or an orchestra would play to “show” that you can feel like you’re in the concert hall

U

U

U

U

Did not realise sound was not coming through Ears!. Eerie sound, first thoughts remind you of the sound of a gramophone

27

M

Y

Comms Eng.

Drummer

Variety of sounds, running water, children playing, oriental female voice, cello, propeller aeroplane, running water etc. etc. Very clearly definable sounds, even at low level. Having suffered with temporary hearing-loss as a child, no surprise to “hear” via the skull – but very interesting to experience the clarity

57

M

N

Tech solutions

Good to give life to older gritty credibility to the pre-digital finds “Olderworldie”. Good to know that not relying on air-borne sound via the ears is not the only methodology that will be condoned; a more “even” field in my perception (which is the “reality” for me – a very subjective thing is aural perception even if it is sent by digital accuracy and time line-up displays) Good to know that neck-transducers could be hidden from view under a shirt collar. (the “pride” factor of the hearing impaired person is still a very reluctant factor – people don’t want others treating them as 2nd class citizens because of an impairment. “I know its only rock an roll, but I liked it” (I just didn’t like being deaf!!)

60

M

Y

Mentor coach

Fascinating – would be better in a quiet environment but impressive

53

M

N

Lecturer

Unusual sensation of vibration on head. Sound is lacking in HF detail. Got clearer toward the end of recordings/

30

M

N

Lecturer

Visceral; immersive “sound” experience. Dull with not much LF either but the vibrations making/shift the experience to something “other” than typical listening. Hand on ear plugs – altered negatively

38

M

Y

Sound

Very surreal distant sounding. Passing sounds such as the train and plane felt closer and move forward. The higher sounds such as water (?) felt harder to make out. Fidelity sometimes felt lost when many sounds were overlapped. As strange as it sounds it was like a memory or dream of a sound

30

M

N

Snd. Eng.

Immersive. Almost noises in your head as you were aware your ears were covered, but as you still “heard” the sounds, you were aware your ears were still in use. The true source was only made aware at loud points when you felt the transducers vibrate, not totally dissimilar to the Jecklin float “no contact” headphones

41

M

N

Snd. Eng.

Could be louder. Sounded good. I would like to try quieter environment to see how good the quality is

55

M

N

Snd. Eng.

A unique experience – almost like the audio version VR. It provides a more intimate experience than headset

59

M

Y

Editor

Very interesting like nothing I’ve ever tried before, amazing

18

M

Y

Apprentice

It felt really strange and when the headset vibrated on my head

20

M

Y

Student

Very spatial experience. Far more effective than ‘3D’ stereo headphones etc. Lacking low frequency depth somewhat. Surprisingly clear and loud given ambient noise

33

M

N

Draftsman

Occasionally you could feel the deeper sounds as physical vibrations especially in the front central point. The higher sounds like bird song were easier to pick up what direction it was coming from. The music sounded better than it would through regular headphones as you felt surrounded by the sound as you would in a realistic setting of an orchestra

18

F

Y

Student

Unusual feeling. Almost feels like it’s coming through your ears due to ear plugs. Vibrations felt for higher pitches – front and back left during train whistle and plane. When plane flies overhead the vibration moves from front to back as though flying over

24

F

Y

LAMDA student

Very interesting! Doesn’t really feel like it came from the skull. But the sound was very clear. Guess it would be awesome for listening to psychedelic music

24

F

Y

Student

A completely bizarre experience, so glad I did it! Its extraordinary technology and so impressive. It’s definitely not what I was expecting. It really is technology of the future and I wish you the best of luck with future development

19

M

Y

Student

It’s actually 3D sound, from all around and above. It felt like it was coming from my ears but more pure

18

M

Y

Student

Literally burst out laughing out of the fact this is truly incredible!

25

M

N

Snd. Eng.

Like nothing I’ve ever experienced before! Absolutely incredible!!!

16

F

N

Student

So amazing, deeper sounds had more clarity

16

F

N

Student

Sound was very clear and you could even feel some of the lesser bass sounds

16

M

Y

Student

Very unusual sonic experience. It felt like a mono soundscape but with a strange depth, a “spatial-mono” (I know it doesn’t make much sense, but it was that unusual!!) Frequency range was not very wide. Dynamic range not that wide either

50

M

Y

Composer

Sounded slightly “muffled” some spatial “separation” but not dramatic

62

M

Y

Con. Producer

Would have been good to compare with the same source through ears! Interesting though – just hope I’m never deaf

61

F

N

Accounts

Very quiet, the low flying sound was clearest. The vibrations were quite strange and difficult to get used to. Very cool though!

22

F

N

Marketing

Very strange as I could feel vibrating on the back of my head, plus the fact I could hear without my ears

21

M

N

Student

I enjoyed the vibrations on the pressure points. Sound has remarkable stereo/surround perception. With ear plugs in, it felt like listening to headphones. A pleasant experience

37

M

Y

Equipment sales

Very left heavy, generally inside head, a little outside

36

M

Y

Rec. Eng.

Loved the vibrations of the aeroplane flying over. and in general how the sound felt all around.

Thanks!

28

M

N

Theatre

Soft bird sounds – different birds getting slowly louder. Move onto classical music- very clear sound. Next train/train whistle, was there a voice to? Some vibration felt – bit weird. Sound quietening down like how it started

46

F

N

Administrator

Feels slightly odd at first but great idea and execution

16

M

N

U

Music feels a lot more comfortable than sound FX. dramatic increases in volume can be quite surprising but I got used to it

16

M

Y

U

Surprised at the definition, clarity plus frequency range – very “natural” feeling

44

M

N

Editor

Very clear and crisp sound. it felt like was immersed within the sound field

36

M

Y

Snd. Eng.

Great adventure, very interesting work, can see it in VR as having future. Would be delighted to hear about it more and be connected

25

F

U

Designer

Mind-blowing and confusing… felt like I was there

46

M

N

Design Eng.

Great sensorial experience. Interesting concept especially for the 3D audio image

24

M

Y

Snd. Eng.

Interesting idea. Not very comfortable after a while. Little bit distortion on high volumes

22

M

Y

Snd. Eng.

Amazing the way it works. Inspired thinking of ways to implement technology. (good dynamics) Sounded like coming from ears, not full range spectrum. (Could hear heartbeat because of the ear plugs)

50

M

U

Snd. Eng.

Amazing technology

27

F

Y

Student

Very interesting, new experience of sound. Vibrations feel slightly unusual but also add a new dimension to the sound experience. Very cool

23

M

Y

DJ

I can feel it tingling in a pleasant way when the train sounded particularly vibrated to my head. I read about a Neuro-phone many years ago and imagine sound is conducted that method? The rain forest, birds, foreign landscape all felt vey spacious, the piano felt lonely and shrill

40+

F

U

Artist

Pretty impressed. At the beginning I heard the ‘noises’ in a park etc. and I could not feel any vibrations until the cello in ‘Nothing else Matters’. Felt the vibrations the most when the women talked

34

M

Y

Event manager

I felt good surround feeling. Sounds were quite clear. I did not realise where the sound came from. So quiet hard to describe where the sound source is. At some point where the music got loud, you feel the vibration when the level is low, I felt like hearing with my ears

34

M

Y

Event manager

Incredible new way of listening, great clarity. Felt strange. Vibration with the plane recording. Sometimes quiet

22

M

Y

Snd Tech

Audio panorama seemed interesting. Was a little faint with background noise from show. Was curious as to what was actually happening with head sensors

66

M

Y

Music educator

Weird but interesting

U

M

U

Student

A surreal auditory experience with lots of depth

28

M

N

Manager

Much improved HF response compared to other systems. Would like to hear in a quieter environment

48

M

Y

Acoustic engineer

Incredible feeling, not sure how this would work in a commercial environment but in education/or therapy could be a very intuitive tool. It all sounds a bit ‘tinny’ but heard the different sounds/effects

51

M

Y

Pro audio sales

Very curious experience, can’t understand the meaning of it

U

U

U

U

I found this experiment very interesting as musician. I been always thought ears are the only source to hear, but this test shows we hear even by our head. All the best

42

M

Y

Music producer

Really impressed by the current frequency response that already existing, will be very original with the advances

28

M

U

Electronic engineer

Good idea, find uses for it. Good luck

51

M

U

Electronic engineer

‘Therapy’

U

U

U

U

I felt rippling nerve? Effects over my scalp (random from playback). Sample piece was very quiet and almost non present in right ear until gain was adjusted. I noticed ‘FX’ send had a high pass effect

50

M

U

Sound composer

I want one! Maybe adding a subwoofer to the experience would be interesting

25

M

N

Sound design

Very strange experience, almost like you are in a dream state

19

M

N

Tech director

Very weird sensation

17

M

N

Student

Interesting, different experience. Sound quality?

36

M

Y

U

It’s a wonderful experience, really like the sound technique. Excellent

33

M

Y

Business

Sounds like audio coming from inside head rather than ears. Slight tickling on head, very pleasurable. A little bass light

43

M

Y

U

Very interesting, I could hear the music clearly enough. I hope this gets developed for the people who might need it

33

M

N

AV Tech

Extremely interesting! Thanks for the demo!

31

M

Y

U

Really interesting, I look forward to using it in a few years. Thanks

51

M

U

Sound engineer

A new way of surround. It feels like surround sound is nothing compared to this. You can also feel the vibrations from the surroundings

31

M

N

Sound engineer

Strange, but a real new experience. Very nice, clear sound

38

M

N

Audio rental

Amazing technology. I can imagine it could be used in covert ops, e.g. SAS. Would be nice not to hear others music on the train too!

27

M

N

Importer

Very interesting. Quite relaxing as the sound is heard first and then you get a head massage! Similar to airborne sound but lacking high frequency content. Very good ambient sound

45

M

Y

Dpt. Engineer

Really amazing to feel and sense the music and sounds around you without actual sound ‘in ears’. The spikes, high levels vibrate against your skull and this gives sense, but interesting to hear without your ears!!

40

M

Y

Music manager

Very interesting concept- would like to use it in conjunction with IEMs. Good luck with the project

62

M

Y

Company manager

Very different from normal hearing, but very audible, ‘sounds inside my head ‘. Very little treble and low bass

U

U

U

U

Great bit of research.. Very surreal

37

M

U

Operations director

Felt/sounded just like it would if wearing headphones. Had to remind myself that sound was actually coming through my head, because the experience was so similar

34

F

U

Actress

Incredibly odd. Felt both normal but not at the same time. Very relaxing

16

F

U

Student

Awesome trip. Great experience. I hope to see more about this tech

U

U

U

U

Although the sound was still ‘one sided ‘ to a certain degree I felt for the first time that I was immersed in a soundscape and that my hearing loss was not making me lose out on part of the effect. The train in particular really felt 360, especially with the chin transducer on my right cheek bone

36

F

U

Stage manager

Felt physical vibrations from head contacts. Would like to have heard headphone comparison. Range seemed to be around 900 hz–4000 kh, but experience was from ear canal directly. Also feel slightly nauseous?

45

M

Y

Sound engineer

It is quite an interesting if somewhat confusing sensation. Hearing without hearing. I had not expected the level of clarity achieved, being able to pick out changes in the soundscape and individual notes in the Chopin piece

28

M

U

Production manager

In the beginning I felt it’s going to fall off my head until I made myself sure it’s the vibrations only. Also at some point I was trying to locate the sound in using my ears, and it was confusing. It’s quite interesting experience, the sound felt quite natural. Wasn’t sure how very reproduced it felt

21

F

N

Student

An amazing experience, hope it can help deaf people

44

F

N

Interior designer

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lennox, P., McKenzie, I., Brown, M. (2018). Feel It in My Bones: Composing Multimodal Experience Through Tissue Conduction. In: Aramaki, M., Davies , M., Kronland-Martinet, R., Ystad, S. (eds) Music Technology with Swing. CMMR 2017. Lecture Notes in Computer Science(), vol 11265. Springer, Cham. https://doi.org/10.1007/978-3-030-01692-0_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-01692-0_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-01691-3

  • Online ISBN: 978-3-030-01692-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics